Sep 16 13:30:55.134877 ip-10-0-129-205 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 13:30:55.489213 ip-10-0-129-205 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 13:30:55.489213 ip-10-0-129-205 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 13:30:55.489213 ip-10-0-129-205 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 13:30:55.489213 ip-10-0-129-205 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 13:30:55.489213 ip-10-0-129-205 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 13:30:55.490583 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.490490    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 13:30:55.494356 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494333    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:30:55.494356 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494350    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:30:55.494356 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494354    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:30:55.494356 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494358    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:30:55.494356 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494361    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494366    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494371    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494374    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494377    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494380    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494384    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494388    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494391    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494394    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494398    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494400    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494403    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494406    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494410    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494413    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494416    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494418    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494421    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:30:55.494579 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494423    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494427    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494429    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494432    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494435    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494437    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494440    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494443    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494445    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494448    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494451    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494454    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494456    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494459    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494461    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494465    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494468    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494470    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494473    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494476    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:30:55.495035 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494478    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494481    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494484    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494486    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494489    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494493    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494495    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494499    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494502    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494505    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494507    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494510    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494513    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494515    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494518    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494521    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494523    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494526    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494528    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:30:55.495567 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494531    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494534    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494536    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494539    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494555    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494558    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494561    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494564    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494567    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494569    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494572    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494575    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494577    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494580    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494584    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494586    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494589    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494592    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494595    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494599    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:30:55.496038 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494602    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494606    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494609    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494611    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494614    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494617    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494620    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494623    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494625    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494628    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494630    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494633    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494635    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494638    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494640    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494643    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.494646    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495338    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495345    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495348    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:30:55.496525 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495351    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495353    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495356    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495359    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495361    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495364    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495367    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495370    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495373    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495377    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495380    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495383    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495385    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495388    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495392    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495394    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495397    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495399    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495402    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495405    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:30:55.497028 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495407    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495412    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495415    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495418    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495421    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495423    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495426    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495428    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495432    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495434    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495437    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495439    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495442    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495445    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495447    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495450    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495453    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495455    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495458    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:30:55.497523 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495460    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495463    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495465    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495468    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495471    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495473    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495476    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495478    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495481    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495484    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495487    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495489    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495491    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495494    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495496    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495500    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495503    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495506    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495509    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:30:55.498040 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495511    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495514    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495517    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495519    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495522    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495524    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495527    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495530    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495532    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495535    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495537    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495539    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495556    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495559    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495561    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495564    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495567    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495570    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495573    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495575    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:30:55.498502 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495578    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495581    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495584    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495588    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495591    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495595    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495597    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495600    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495602    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495605    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495608    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495611    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495613    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495616    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495619    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495622    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495624    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.495627    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496025    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496031    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:30:55.499013 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496034    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496036    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496039    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496042    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496045    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496048    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496050    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496053    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496056    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496058    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496061    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496064    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496066    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496069    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496072    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496075    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496077    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496080    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496082    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496085    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:30:55.499491 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496087    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496090    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496092    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496095    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496097    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496102    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496105    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496107    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496110    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496113    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496118    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496121    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496124    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496127    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496130    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496133    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496135    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496138    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496140    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:30:55.499992 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496143    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496146    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496148    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496151    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496153    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496156    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496158    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496161    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496164    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496166    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496169    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496172    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496175    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496177    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496180    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496182    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496184    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496187    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496192    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496194    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:30:55.500488 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496197    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496200    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496203    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496205    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496209    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496213    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496217    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496221    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496225    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496228    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496231    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496234    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496236    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496239    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496242    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496245    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496247    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496250    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496253    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:30:55.501005 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496255    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496258    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496260    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496263    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496266    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496268    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496271    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496273    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496275    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496278    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496280    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496284    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496287    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496291    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496293    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496296    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496298    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496301    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.496303    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496371    2552 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496405    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 13:30:55.501478 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496412    2552 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496417    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496421    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496424    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496428    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496432    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496435    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496438    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496441    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496445    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496448    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496451    2552 flags.go:64] FLAG: --cgroup-root=""
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496454    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496457    2552 flags.go:64] FLAG: --client-ca-file=""
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496460    2552 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496463    2552 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496467    2552 flags.go:64] FLAG: --cluster-domain=""
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496470    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496473    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496476    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496479    2552 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496483    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496487    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 13:30:55.502066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496490    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496495    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496498    2552 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496501    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496504    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496507    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496510    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496514    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496517    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496520    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496523    2552 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496526    2552 flags.go:64] FLAG: --enable-server="true"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496529    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496534    2552 flags.go:64] FLAG: --event-burst="100"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496537    2552 flags.go:64] FLAG: --event-qps="50"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496552    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496556    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496559    2552 flags.go:64] FLAG: --eviction-hard=""
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496563    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496566    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496569    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496572    2552 flags.go:64] FLAG: --eviction-soft=""
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496575    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496578    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496581    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 13:30:55.502637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496584    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496587    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496589    2552 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496592    2552 flags.go:64] FLAG: --feature-gates=""
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496596    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496599    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496603    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496607    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496611    2552 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496614    2552 flags.go:64] FLAG: --help="false"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496617    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496620    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496623    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496626    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496629    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496632    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496635    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496638    2552 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496641    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496643    2552 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496646    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496649    2552 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496652    2552 flags.go:64] FLAG: --kube-reserved=""
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496655    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 13:30:55.503296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496658    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496661    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496664    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496666    2552 flags.go:64] FLAG: --lock-file=""
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496669    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496672    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496675    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496680    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496684    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496687    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496690    2552 flags.go:64] FLAG: --logging-format="text"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496693    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496696    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496698    2552 flags.go:64] FLAG: --manifest-url=""
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496702    2552 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496706    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496712    2552 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496716    2552 flags.go:64] FLAG: --max-pods="110"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496719    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496722    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496725    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496728    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496731    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496734    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496737    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 13:30:55.503895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496744    2552 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496747    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496750    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496753    2552 flags.go:64] FLAG: --pod-cidr=""
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496756    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496761    2552 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496764    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496767    2552 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496770    2552 flags.go:64] FLAG: --port="10250"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496773    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496776    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-083cc62bd78f53be1"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496779    2552 flags.go:64] FLAG: --qos-reserved=""
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496782    2552 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496785    2552 flags.go:64] FLAG: --register-node="true"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496788    2552 flags.go:64] FLAG: --register-with-taints=""
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496791    2552 flags.go:64] FLAG: --registry-burst="10"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496795    2552 flags.go:64] FLAG: --registry-qps="5"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496798    2552 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496801    2552 flags.go:64] FLAG: --reserved-memory=""
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496804    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496807    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496811    2552 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496814    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496817    2552 flags.go:64] FLAG: --runonce="false"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496821    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 13:30:55.504499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496824    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496827    2552 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496830    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496833    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496836    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496839    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496842    2552 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496845    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496848    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496850    2552 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496853    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496856    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496860    2552 flags.go:64] FLAG: --system-cgroups=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496862    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496867    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496870    2552 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496873    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496877    2552 flags.go:64] FLAG: --tls-min-version=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496879    2552 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496882    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496885    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496888    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496891    2552 flags.go:64] FLAG: --v="2"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496894    2552 flags.go:64] FLAG: --version="false"
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496898    2552 flags.go:64] FLAG: --vmodule=""
Sep 16 13:30:55.505132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496902    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.496905    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497032    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497038    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497041    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497044    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497048    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497051    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497053    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497056    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497058    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497061    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497064    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497067    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497069    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497072    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497075    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497077    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497080    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497082    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:30:55.505734 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497085    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497088    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497090    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497093    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497095    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497098    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497100    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497103    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497105    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497108    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497110    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497113    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497116    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497118    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497121    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497124    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497127    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497129    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497133    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497135    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:30:55.506219 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497138    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497141    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497144    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497147    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497149    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497152    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497154    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497157    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497160    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497162    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497166    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497170    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497173    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497176    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497178    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497181    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497183    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497186    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497188    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497191    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:30:55.506726 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497193    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497196    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497199    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497201    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497204    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497207    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497209    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497212    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497215    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497218    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497221    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497224    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497227    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497229    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497232    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497235    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497237    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497239    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497242    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497244    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:30:55.507237 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497247    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497250    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497252    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497255    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497257    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497260    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497262    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497265    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497267    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497270    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497273    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497275    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497278    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497280    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497283    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497287    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497290    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497293    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497296    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:30:55.507738 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497300    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.497303    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.497855    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.504454    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.504468    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.505831    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.505850    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505937    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505943    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505947    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505950    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505954    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505957    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505960    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:30:55.508216 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505963    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505966    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505969    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505972    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505974    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505977    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505980    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505982    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505985    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505988    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505990    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505993    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505996    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.505998    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506001    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506003    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506006    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506009    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506012    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506014    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:30:55.508623 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506018    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506020    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506023    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506026    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506028    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506032    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506034    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506038    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506043    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506046    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506049    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506052    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506054    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506057    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506060    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506063    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506065    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506068    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506070    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506073    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:30:55.509118 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506076    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506079    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506081    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506083    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506086    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506089    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506091    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506094    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506096    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506100    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506104    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506107    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506111    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506114    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506117    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506121    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506125    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506128    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506131    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:30:55.509680 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506134    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506136    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506139    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506142    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506145    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506147    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506150    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506152    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506155    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506157    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506160    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506162    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506165    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506167    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506170    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506173    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506175    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506178    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506180    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506183    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:30:55.510175 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506185    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506188    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506190    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506193    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506197    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506200    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506203    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506205    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506208    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506211    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506214    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506217    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506220    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.506225    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506351    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 13:30:55.510776 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506355    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506358    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506362    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506365    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506367    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506370    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506372    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506375    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506378    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506380    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506383    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506385    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506388    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506390    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506393    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506395    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506398    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506400    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506403    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506406    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 13:30:55.511149 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506409    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506413    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506417    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506422    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506426    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506430    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506433    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506436    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506439    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506441    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506444    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506446    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506449    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506451    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506454    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506457    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506459    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506462    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506464    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506467    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 13:30:55.511633 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506469    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506472    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506474    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506477    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506479    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506482    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506484    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506487    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506489    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506492    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506494    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506496    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506499    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506501    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506504    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506507    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506510    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506513    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506516    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506518    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 13:30:55.512116 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506521    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506523    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506526    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506528    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506531    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506533    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506536    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506538    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506556    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506561    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506564    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506567    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506569    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506573    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506577    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506579    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506582    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506585    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506588    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 13:30:55.512632 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506590    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506593    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506596    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506598    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506601    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506603    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506606    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506608    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506611    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506615    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506617    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506620    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506623    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506626    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506628    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506631    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506633    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506636    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 13:30:55.513180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:55.506638    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.506643    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.506736    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.509122    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.509972    2552 server.go:1019] "Starting client certificate rotation"
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.510070    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.510099    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 13:30:55.513641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.512519    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 13:30:55.516318 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.516301    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 13:30:55.528534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.528510    2552 log.go:25] "Validated CRI v1 runtime API"
Sep 16 13:30:55.531148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.531130    2552 log.go:25] "Validated CRI v1 image API"
Sep 16 13:30:55.531980 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.531962    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 13:30:55.535525 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.535507    2552 fs.go:135] Filesystem UUIDs: map[2452cbed-6354-4383-b887-36cae9200b08:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94890d56-9bd6-457f-9a68-22f1a12dc696:/dev/nvme0n1p3]
Sep 16 13:30:55.535602 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.535525    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 13:30:55.541229 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.541104    2552 manager.go:216] Machine: {Timestamp:2026-09-16 13:30:55.539126641 +0000 UTC m=+0.292816753 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099930 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c62da1174475be20aad30fb3657a2 SystemUUID:ec2c62da-1174-475b-e20a-ad30fb3657a2 BootID:1b22f805-cb83-4ef7-92d7-60e7e7c1c101 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cf:b8:67:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cf:b8:67:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:51:f1:a1:b1:91 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 13:30:55.541229 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.541221    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 13:30:55.541362 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.541325    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 13:30:55.543321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.543301    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 13:30:55.544282 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.544256    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 13:30:55.544424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.544286    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 13:30:55.545001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.544983    2552 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 13:30:55.545041 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.545002    2552 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 13:30:55.545041 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.545010    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 13:30:55.545903 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.545893    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 13:30:55.546772 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.546763    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 13:30:55.550375 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550365    2552 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 13:30:55.550500 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550491    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 13:30:55.550533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550520    2552 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 13:30:55.550533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550529    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 13:30:55.550632 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550560    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 13:30:55.550632 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550571    2552 kubelet.go:398] "Adding apiserver pod source"
Sep 16 13:30:55.550632 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550593    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 13:30:55.550928 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550917    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 13:30:55.550961 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.550942    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 13:30:55.552952 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.552933    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 13:30:55.555132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.555118    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 13:30:55.555185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.555148    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 13:30:55.556679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556666    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556683    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556689    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556695    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556708    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556716    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556730    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 13:30:55.556739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556737    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 13:30:55.557000 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556744    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 13:30:55.557000 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556749    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 13:30:55.557000 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556765    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 13:30:55.557000 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.556770    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 13:30:55.558217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.558205    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 13:30:55.558217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.558217    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 13:30:55.560539 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.560507    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 13:30:55.560661 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.560614    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 13:30:55.562112 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.562097    2552 server.go:1268] "Started kubelet"
Sep 16 13:30:55.562206 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.562175    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 13:30:55.562275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.562223    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 13:30:55.562348 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.562335    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 13:30:55.563140 ip-10-0-129-205 systemd[1]: Started Kubernetes Kubelet.
Sep 16 13:30:55.567051 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.567027    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 13:30:55.568041 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.568023    2552 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 13:30:55.568706 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.568647    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7c7k2"
Sep 16 13:30:55.571427 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.571408    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 13:30:55.573525 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.573508    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 13:30:55.573627 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.573610    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:55.573693 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.573680    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 13:30:55.574202 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.573824    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 13:30:55.574202 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574114    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 13:30:55.574202 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574128    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 13:30:55.574202 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574147    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 13:30:55.574410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574210    2552 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 13:30:55.574410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574217    2552 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 13:30:55.574500 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574434    2552 factory.go:55] Registering systemd factory
Sep 16 13:30:55.574500 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574446    2552 factory.go:223] Registration of the systemd container factory successfully
Sep 16 13:30:55.574683 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574668    2552 factory.go:153] Registering CRI-O factory
Sep 16 13:30:55.574741 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574685    2552 factory.go:223] Registration of the crio container factory successfully
Sep 16 13:30:55.574741 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574732    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 13:30:55.574842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574750    2552 factory.go:103] Registering Raw factory
Sep 16 13:30:55.574842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.574768    2552 manager.go:1196] Started watching for new ooms in manager
Sep 16 13:30:55.574932 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.573716    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-205.ec2.internal.18d5d04ce1160d7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-205.ec2.internal,UID:ip-10-0-129-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-205.ec2.internal,},FirstTimestamp:2026-09-16 13:30:55.56205094 +0000 UTC m=+0.315741053,LastTimestamp:2026-09-16 13:30:55.56205094 +0000 UTC m=+0.315741053,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-205.ec2.internal,}"
Sep 16 13:30:55.575156 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.575142    2552 manager.go:349] Starting recovery of all containers
Sep 16 13:30:55.575726 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.575706    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 13:30:55.575819 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.575800    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 13:30:55.577035 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.577014    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7c7k2"
Sep 16 13:30:55.587270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.587253    2552 manager.go:354] Recovery completed
Sep 16 13:30:55.591390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.591375    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.593395 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593373    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.593460 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593402    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.593460 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593415    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.593893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593879    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 13:30:55.593893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593890    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 13:30:55.593893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593893    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.594065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.593907    2552 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 13:30:55.594702 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.594683    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.594787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.594714    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.594787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.594734    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.674313 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.674286    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:55.737151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.737133    2552 policy_none.go:49] "None policy: Start"
Sep 16 13:30:55.737151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.737155    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 13:30:55.737309 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.737171    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 13:30:55.739738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.739689    2552 policy_none.go:47] "Start"
Sep 16 13:30:55.774869 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.774850    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:55.780070 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780057    2552 manager.go:337] "Starting Device Plugin manager"
Sep 16 13:30:55.780129 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.780090    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 13:30:55.780129 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780100    2552 server.go:87] "Starting device plugin registration server"
Sep 16 13:30:55.780358 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780347    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 13:30:55.780415 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780360    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 13:30:55.780481 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780464    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 13:30:55.780574 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780553    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 13:30:55.780574 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.780563    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 13:30:55.781079 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.781057    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 13:30:55.781179 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.781104    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:55.781348 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.781331    2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-205.ec2.internal\" not found" node="ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.829744 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.829709    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 13:30:55.830882 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.830862    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 13:30:55.830939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.830928    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 13:30:55.830985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.830958    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 13:30:55.831032 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.831011    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 13:30:55.833405 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.833382    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:30:55.880603 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.880575    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.881532 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.881513    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.881627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.881566    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.881627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.881579    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.881627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.881606    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.890458 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.890442    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.890527 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.890464    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-205.ec2.internal\": node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:55.900592 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.900574    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:55.931216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.931194    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"]
Sep 16 13:30:55.931288 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.931258    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.932141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.932127    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.932213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.932154    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.932213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.932163    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.934278 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.934266    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.934398 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.934383    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.934436 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.934416    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.934997 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.934982    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.935068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.935007    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.935068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.935016    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.935068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.934984    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.935167 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.935084    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.935167 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.935095    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.937122 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.937109    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.937187 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.937132    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 13:30:55.937813 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.937797    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 13:30:55.937876 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.937829    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 13:30:55.937876 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.937845    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeHasSufficientPID"
Sep 16 13:30:55.972078 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.972055    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-205.ec2.internal\" not found" node="ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.976400 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.976379    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb68f00172f0a347af69ef95526d7c0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"bb68f00172f0a347af69ef95526d7c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.976482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.976415    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e413a23ab9533a4b31565bf83d28336b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-205.ec2.internal\" (UID: \"e413a23ab9533a4b31565bf83d28336b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.976482 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:55.976432    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-205.ec2.internal\" not found" node="ip-10-0-129-205.ec2.internal"
Sep 16 13:30:55.976482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:55.976439    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bb68f00172f0a347af69ef95526d7c0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"bb68f00172f0a347af69ef95526d7c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.001028 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.000983    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:56.077389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.077355    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bb68f00172f0a347af69ef95526d7c0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"bb68f00172f0a347af69ef95526d7c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.077537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.077393    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb68f00172f0a347af69ef95526d7c0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"bb68f00172f0a347af69ef95526d7c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.077537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.077411    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e413a23ab9533a4b31565bf83d28336b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-205.ec2.internal\" (UID: \"e413a23ab9533a4b31565bf83d28336b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.077537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.077467    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bb68f00172f0a347af69ef95526d7c0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"bb68f00172f0a347af69ef95526d7c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.077537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.077478    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e413a23ab9533a4b31565bf83d28336b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-205.ec2.internal\" (UID: \"e413a23ab9533a4b31565bf83d28336b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.077537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.077470    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb68f00172f0a347af69ef95526d7c0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal\" (UID: \"bb68f00172f0a347af69ef95526d7c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.101513 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.101490    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:56.202178 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.202151    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:56.278901 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.278823    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.279002 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.278834    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.303352 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.303220    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:56.404966 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.404918    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-205.ec2.internal\" not found"
Sep 16 13:30:56.454740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.454721    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:30:56.474408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.474383    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.487401 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.487383    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 13:30:56.489260 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.489246    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal"
Sep 16 13:30:56.498689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.498672    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 13:30:56.510360 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.510338    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 13:30:56.510469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.510448    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 13:30:56.510516 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.510449    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 13:30:56.553608 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.553539    2552 apiserver.go:52] "Watching apiserver"
Sep 16 13:30:56.571903 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.571873    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 13:30:56.572261 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.572241    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-bm6k9","openshift-network-diagnostics/network-check-target-kgjgf","openshift-network-operator/iptables-alerter-g9nwh","kube-system/global-pull-secret-syncer-kzns5","kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57","openshift-dns/node-resolver-n67hz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal","openshift-multus/multus-mjcf8","openshift-ovn-kubernetes/ovnkube-node-fz9sf","kube-system/konnectivity-agent-gdt8m","openshift-cluster-node-tuning-operator/tuned-kqwdc","openshift-image-registry/node-ca-7dccn","openshift-multus/multus-additional-cni-plugins-spfqx"]
Sep 16 13:30:56.574470 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.574456    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 13:30:56.574782 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.574767    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.576908 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.576891    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.577993 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.577974    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.578082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.578001    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x2s27\""
Sep 16 13:30:56.578082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.578008    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.579074 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.579054    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.581429 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581326    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-hosts-file\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.581429 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581375    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-tmp-dir\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.581637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581493    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4q5w\" (UniqueName: \"kubernetes.io/projected/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-kube-api-access-q4q5w\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.581637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581511    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.581637 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.581597    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:30:56.581803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581687    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-prnkq\""
Sep 16 13:30:56.581803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581706    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 13:30:56.581803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581712    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 13:30:56.581955 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581853    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 13:25:56 +0000 UTC" deadline="2028-06-24 13:50:15.25426005 +0000 UTC"
Sep 16 13:30:56.581955 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.581932    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15528h19m18.672332729s"
Sep 16 13:30:56.582976 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.582960    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.583341 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.583325    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mxmlk\""
Sep 16 13:30:56.583503 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.583489    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.583584 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.583521    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 13:30:56.584044 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.584026    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.586332 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.586317    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.586863 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.586846    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 13:30:56.586932 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.586845    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.586932 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.586893    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 13:30:56.587365 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.587345    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.587508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.587493    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 13:30:56.587945 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.587929    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnr5g\""
Sep 16 13:30:56.588614 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.588600    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.590199 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.590180    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 13:30:56.590363 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.590347    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 13:30:56.590428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.590375    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-68mtn\""
Sep 16 13:30:56.590492 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.590467    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.590570 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.590553    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.590937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.590926    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.591888 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.591872    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mfwnd\""
Sep 16 13:30:56.591888 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.591880    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 13:30:56.593385 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.593367    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:30:56.593478 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.593454    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:30:56.593709 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.593693    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.593794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.593780    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.594101 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.594086    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n47v5\""
Sep 16 13:30:56.594658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.594643    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 13:30:56.595858 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.595846    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.598315 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.598297    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:56.598401 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.598363    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:30:56.600772 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.600750    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.601665 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.601646    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 13:30:56.603967 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.602765    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 13:30:56.603967 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.603223    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.603967 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.603234    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 13:30:56.603967 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.603472    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r9f9p\""
Sep 16 13:30:56.603967 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.603817    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.604273 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.604257    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 13:30:56.604496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.604481    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:30:56.604668 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.604655    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-54zlg\""
Sep 16 13:30:56.607463 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.607447    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 13:30:56.625037 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.625021    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5brj"
Sep 16 13:30:56.634169 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.634155    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5brj"
Sep 16 13:30:56.676027 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.676000    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 13:30:56.677514 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.677483    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:30:56.681880 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681861    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:30:56.681971 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681891    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-hosts-file\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.681971 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681909    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-cni-bin\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.681971 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681926    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5ce7a17-adf6-4b5c-aa92-cee2f739c323-agent-certs\") pod \"konnectivity-agent-gdt8m\" (UID: \"c5ce7a17-adf6-4b5c-aa92-cee2f739c323\") " pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.681971 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681942    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58x8\" (UniqueName: \"kubernetes.io/projected/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-kube-api-access-q58x8\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.681971 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681962    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.682148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.681995    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-hosts-file\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.682148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682019    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-cnibin\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682064    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-log-socket\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682082    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovnkube-config\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682099    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-tuned\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682144    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-netns\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682184    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-var-lib-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682200    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-etc-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682216    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovn-node-metrics-cert\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682240    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85phx\" (UniqueName: \"kubernetes.io/projected/a2dc6ee0-6238-4905-91b8-e77664b202bf-kube-api-access-85phx\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682261    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-modprobe-d\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682276    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgcpz\" (UniqueName: \"kubernetes.io/projected/449851ae-d2f3-43eb-a483-b61c76b7b172-kube-api-access-sgcpz\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682291    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk77l\" (UniqueName: \"kubernetes.io/projected/0dd23045-d76e-4fbe-acdf-a186f3010925-kube-api-access-gk77l\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682314    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-system-cni-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682334    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682353    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682372    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b054665-a613-4bcb-a491-3a7c879297ae-cni-binary-copy\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682391    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-hostroot\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682411    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b054665-a613-4bcb-a491-3a7c879297ae-multus-daemon-config\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682430    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4q5w\" (UniqueName: \"kubernetes.io/projected/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-kube-api-access-q4q5w\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682445    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682459    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovnkube-script-lib\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682542 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682499    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8895c9fb-6858-4e65-8026-7bfe790ae660-kubelet-config\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-registration-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682606    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysctl-conf\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682642    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-iptables-alerter-script\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682670    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-ovn\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682691    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysconfig\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682714    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-sys\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682737    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-var-lib-kubelet\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682754    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-host-slash\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682772    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-etc-kubernetes\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682789    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-cni-netd\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682829    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s57mw\" (UniqueName: \"kubernetes.io/projected/0723d64e-668f-43fa-af2d-02f4cf0d5872-kube-api-access-s57mw\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-cnibin\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682868    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-kubelet\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.682905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682897    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-run\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682918    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5ce7a17-adf6-4b5c-aa92-cee2f739c323-konnectivity-ca\") pod \"konnectivity-agent-gdt8m\" (UID: \"c5ce7a17-adf6-4b5c-aa92-cee2f739c323\") " pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682935    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-system-cni-dir\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682962    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-conf-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682981    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-systemd\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.682998    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g9r4\" (UniqueName: \"kubernetes.io/projected/1f513feb-83d6-498f-9ac9-cb5992a17049-kube-api-access-2g9r4\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683013    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-kubernetes\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683030    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysctl-d\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683069    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-kubelet\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683088    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8895c9fb-6858-4e65-8026-7bfe790ae660-dbus\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683106    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0723d64e-668f-43fa-af2d-02f4cf0d5872-host\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683122    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-lib-modules\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683150    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683170    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-cni-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683188    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-socket-dir-parent\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683212    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-tmp-dir\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.683302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683243    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683288    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683307    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-sys-fs\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-cni-bin\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683361    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-socket-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683391    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-cni-binary-copy\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683415    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683439    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-k8s-cni-cncf-io\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-cni-multus\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683488    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-env-overrides\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-device-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683526    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-tmp-dir\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683539    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-systemd-units\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683587    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-slash\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683624    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-node-log\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683646    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tr66\" (UniqueName: \"kubernetes.io/projected/8f057a5b-7478-4edf-95db-99245dd6bf3e-kube-api-access-7tr66\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:56.683787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683664    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683682    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-systemd\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683712    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-host\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/449851ae-d2f3-43eb-a483-b61c76b7b172-tmp\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-run-netns\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683782    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683802    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0723d64e-668f-43fa-af2d-02f4cf0d5872-serviceca\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683817    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-multus-certs\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.684280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.683833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9v4\" (UniqueName: \"kubernetes.io/projected/3b054665-a613-4bcb-a491-3a7c879297ae-kube-api-access-9d9v4\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.689856 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.689839    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 13:30:56.693340 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.693316    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4q5w\" (UniqueName: \"kubernetes.io/projected/aa33aaef-f00a-4bd4-995a-c695a7ab5cf1-kube-api-access-q4q5w\") pod \"node-resolver-n67hz\" (UID: \"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1\") " pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.784942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.784908    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-cni-netd\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.784942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.784944    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s57mw\" (UniqueName: \"kubernetes.io/projected/0723d64e-668f-43fa-af2d-02f4cf0d5872-kube-api-access-s57mw\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.785186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.784962    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-cnibin\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.785186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.784978    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-kubelet\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.785186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785022    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-cnibin\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.785186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785051    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-cni-netd\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.785345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785206    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-kubelet\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.785345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785254    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-run\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.785345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785281    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5ce7a17-adf6-4b5c-aa92-cee2f739c323-konnectivity-ca\") pod \"konnectivity-agent-gdt8m\" (UID: \"c5ce7a17-adf6-4b5c-aa92-cee2f739c323\") " pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.785345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785302    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-system-cni-dir\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.785345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785327    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-conf-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785351    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-systemd\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785380    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-system-cni-dir\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785374    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g9r4\" (UniqueName: \"kubernetes.io/projected/1f513feb-83d6-498f-9ac9-cb5992a17049-kube-api-access-2g9r4\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785395    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-conf-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785429    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-kubernetes\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785430    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-run\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785454    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysctl-d\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785479    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-kubelet\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785500    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8895c9fb-6858-4e65-8026-7bfe790ae660-dbus\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785430    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-systemd\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785541    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-kubelet\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.785581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785521    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-kubernetes\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785609    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysctl-d\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785606    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0723d64e-668f-43fa-af2d-02f4cf0d5872-host\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785638    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8895c9fb-6858-4e65-8026-7bfe790ae660-dbus\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785670    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-lib-modules\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785673    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0723d64e-668f-43fa-af2d-02f4cf0d5872-host\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785712    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785734    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-cni-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785754    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-socket-dir-parent\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785769    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-lib-modules\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785779    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785807    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785831    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-cni-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785837    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-multus-socket-dir-parent\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785834    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-sys-fs\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785834    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785876    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-sys-fs\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785888    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-cni-bin\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785914    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-socket-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785876    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5ce7a17-adf6-4b5c-aa92-cee2f739c323-konnectivity-ca\") pod \"konnectivity-agent-gdt8m\" (UID: \"c5ce7a17-adf6-4b5c-aa92-cee2f739c323\") " pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785937    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-cni-binary-copy\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785923    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-cni-bin\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785924    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.785986    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-k8s-cni-cncf-io\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786021    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-cni-multus\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786032    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-k8s-cni-cncf-io\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786037    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-socket-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786071    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-env-overrides\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786094    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-device-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786099    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-var-lib-cni-multus\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786126    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-systemd-units\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786151    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-slash\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786179    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dd23045-d76e-4fbe-acdf-a186f3010925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.786774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786183    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-device-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786198    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-node-log\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786222    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-systemd-units\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786235    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-node-log\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786235    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tr66\" (UniqueName: \"kubernetes.io/projected/8f057a5b-7478-4edf-95db-99245dd6bf3e-kube-api-access-7tr66\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786270    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786300    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-systemd\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-host\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786351    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.786362    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786367    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/449851ae-d2f3-43eb-a483-b61c76b7b172-tmp\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786404    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-run-netns\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.786441    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:30:57.286418846 +0000 UTC m=+2.040108962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786456    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-run-netns\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786461    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786469    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-cni-binary-copy\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786272    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-slash\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.787655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786492    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0723d64e-668f-43fa-af2d-02f4cf0d5872-serviceca\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786524    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-multus-certs\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786531    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-systemd\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786567    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-env-overrides\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786572    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9v4\" (UniqueName: \"kubernetes.io/projected/3b054665-a613-4bcb-a491-3a7c879297ae-kube-api-access-9d9v4\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786636    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-host\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786571    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-multus-certs\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786651    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786719    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-cni-bin\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786749    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5ce7a17-adf6-4b5c-aa92-cee2f739c323-agent-certs\") pod \"konnectivity-agent-gdt8m\" (UID: \"c5ce7a17-adf6-4b5c-aa92-cee2f739c323\") " pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786758    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-host-cni-bin\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786783    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58x8\" (UniqueName: \"kubernetes.io/projected/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-kube-api-access-q58x8\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786880    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786920    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0723d64e-668f-43fa-af2d-02f4cf0d5872-serviceca\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786921    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-cnibin\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786967    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-cnibin\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.786960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-log-socket\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.788535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787005    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-log-socket\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787016    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovnkube-config\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787048    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-tuned\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787072    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-netns\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787098    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-var-lib-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787125    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-host-run-netns\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787147    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-etc-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787178    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovn-node-metrics-cert\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787183    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-var-lib-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787205    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85phx\" (UniqueName: \"kubernetes.io/projected/a2dc6ee0-6238-4905-91b8-e77664b202bf-kube-api-access-85phx\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-modprobe-d\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787265    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgcpz\" (UniqueName: \"kubernetes.io/projected/449851ae-d2f3-43eb-a483-b61c76b7b172-kube-api-access-sgcpz\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787292    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk77l\" (UniqueName: \"kubernetes.io/projected/0dd23045-d76e-4fbe-acdf-a186f3010925-kube-api-access-gk77l\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787317    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-system-cni-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787344    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787369    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787394    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b054665-a613-4bcb-a491-3a7c879297ae-cni-binary-copy\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.789262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787434    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dd23045-d76e-4fbe-acdf-a186f3010925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787544    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-modprobe-d\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787557    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovnkube-config\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787239    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-etc-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787630    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-hostroot\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787664    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b054665-a613-4bcb-a491-3a7c879297ae-multus-daemon-config\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787720    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovnkube-script-lib\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787747    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8895c9fb-6858-4e65-8026-7bfe790ae660-kubelet-config\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787777    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-registration-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787804    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysctl-conf\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.787825    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787831    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-iptables-alerter-script\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787860    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-ovn\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787873    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.787880    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:30:57.287862151 +0000 UTC m=+2.041552267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787909    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-ovn\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.790089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787922    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysconfig\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787951    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-sys\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787975    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8895c9fb-6858-4e65-8026-7bfe790ae660-kubelet-config\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787979    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-var-lib-kubelet\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788004    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-host-slash\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788029    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f513feb-83d6-498f-9ac9-cb5992a17049-registration-dir\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788034    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-etc-kubernetes\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788107    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-etc-kubernetes\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788145    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysctl-conf\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788159    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-sysconfig\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788211    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-var-lib-kubelet\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788255    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-host-slash\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788369    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-hostroot\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.787664    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b054665-a613-4bcb-a491-3a7c879297ae-system-cni-dir\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788451    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovnkube-script-lib\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788473    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2dc6ee0-6238-4905-91b8-e77664b202bf-run-openvswitch\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788541    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/449851ae-d2f3-43eb-a483-b61c76b7b172-sys\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788553    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b054665-a613-4bcb-a491-3a7c879297ae-cni-binary-copy\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.791102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788745    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-iptables-alerter-script\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.792082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.788781    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b054665-a613-4bcb-a491-3a7c879297ae-multus-daemon-config\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.792082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.790006    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5ce7a17-adf6-4b5c-aa92-cee2f739c323-agent-certs\") pod \"konnectivity-agent-gdt8m\" (UID: \"c5ce7a17-adf6-4b5c-aa92-cee2f739c323\") " pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.792082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.790239    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/449851ae-d2f3-43eb-a483-b61c76b7b172-tmp\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.792082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.790827    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/449851ae-d2f3-43eb-a483-b61c76b7b172-etc-tuned\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.792082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.791311    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2dc6ee0-6238-4905-91b8-e77664b202bf-ovn-node-metrics-cert\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.800606 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.800569    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s57mw\" (UniqueName: \"kubernetes.io/projected/0723d64e-668f-43fa-af2d-02f4cf0d5872-kube-api-access-s57mw\") pod \"node-ca-7dccn\" (UID: \"0723d64e-668f-43fa-af2d-02f4cf0d5872\") " pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:56.801093 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.801074    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g9r4\" (UniqueName: \"kubernetes.io/projected/1f513feb-83d6-498f-9ac9-cb5992a17049-kube-api-access-2g9r4\") pod \"aws-ebs-csi-driver-node-vrm57\" (UID: \"1f513feb-83d6-498f-9ac9-cb5992a17049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.805961 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.805903    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:30:56.805961 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.805931    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:30:56.805961 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.805944    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:30:56.806177 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:56.806015    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:30:57.305998997 +0000 UTC m=+2.059689122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:30:56.806402 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.806384    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58x8\" (UniqueName: \"kubernetes.io/projected/488f2f54-1fdd-4f64-b5ec-95ad3f7e6847-kube-api-access-q58x8\") pod \"iptables-alerter-g9nwh\" (UID: \"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847\") " pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.806769 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.806749    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk77l\" (UniqueName: \"kubernetes.io/projected/0dd23045-d76e-4fbe-acdf-a186f3010925-kube-api-access-gk77l\") pod \"multus-additional-cni-plugins-spfqx\" (UID: \"0dd23045-d76e-4fbe-acdf-a186f3010925\") " pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.806832 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.806767    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85phx\" (UniqueName: \"kubernetes.io/projected/a2dc6ee0-6238-4905-91b8-e77664b202bf-kube-api-access-85phx\") pod \"ovnkube-node-fz9sf\" (UID: \"a2dc6ee0-6238-4905-91b8-e77664b202bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:56.806874 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.806834    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tr66\" (UniqueName: \"kubernetes.io/projected/8f057a5b-7478-4edf-95db-99245dd6bf3e-kube-api-access-7tr66\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:56.807247 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.807227    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9v4\" (UniqueName: \"kubernetes.io/projected/3b054665-a613-4bcb-a491-3a7c879297ae-kube-api-access-9d9v4\") pod \"multus-mjcf8\" (UID: \"3b054665-a613-4bcb-a491-3a7c879297ae\") " pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.807653 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.807631    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgcpz\" (UniqueName: \"kubernetes.io/projected/449851ae-d2f3-43eb-a483-b61c76b7b172-kube-api-access-sgcpz\") pod \"tuned-kqwdc\" (UID: \"449851ae-d2f3-43eb-a483-b61c76b7b172\") " pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:56.905281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.905235    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n67hz"
Sep 16 13:30:56.921039 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.921015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:30:56.925092 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.925065    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb68f00172f0a347af69ef95526d7c0e.slice/crio-57675589c85007d14f5b25236e394f9d5c034a287555b8b26f1c5896eb47ce98 WatchSource:0}: Error finding container 57675589c85007d14f5b25236e394f9d5c034a287555b8b26f1c5896eb47ce98: Status 404 returned error can't find the container with id 57675589c85007d14f5b25236e394f9d5c034a287555b8b26f1c5896eb47ce98
Sep 16 13:30:56.925717 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.925692    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa33aaef_f00a_4bd4_995a_c695a7ab5cf1.slice/crio-5e20b5000dd32cc941d868dea90a59221fa83d8d4c1583a07fc5c5fc2bd2a68c WatchSource:0}: Error finding container 5e20b5000dd32cc941d868dea90a59221fa83d8d4c1583a07fc5c5fc2bd2a68c: Status 404 returned error can't find the container with id 5e20b5000dd32cc941d868dea90a59221fa83d8d4c1583a07fc5c5fc2bd2a68c
Sep 16 13:30:56.926294 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.926271    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode413a23ab9533a4b31565bf83d28336b.slice/crio-7238290b6c6ae932336e0e3e994e0714dfbc74bec5c453a06676aa7fb3cddc98 WatchSource:0}: Error finding container 7238290b6c6ae932336e0e3e994e0714dfbc74bec5c453a06676aa7fb3cddc98: Status 404 returned error can't find the container with id 7238290b6c6ae932336e0e3e994e0714dfbc74bec5c453a06676aa7fb3cddc98
Sep 16 13:30:56.929919 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.929902    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:30:56.931578 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.931558    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ce7a17_adf6_4b5c_aa92_cee2f739c323.slice/crio-dd46ad403583236337b42846762a09bd58363ac1d43fa0889e2337a6df085a22 WatchSource:0}: Error finding container dd46ad403583236337b42846762a09bd58363ac1d43fa0889e2337a6df085a22: Status 404 returned error can't find the container with id dd46ad403583236337b42846762a09bd58363ac1d43fa0889e2337a6df085a22
Sep 16 13:30:56.939908 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.939891    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9nwh"
Sep 16 13:30:56.948903 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.948882    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-spfqx"
Sep 16 13:30:56.949531 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.949511    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488f2f54_1fdd_4f64_b5ec_95ad3f7e6847.slice/crio-7d250b85bb655e7f08772dc74ae5937b093a77d27942d57fe4725426ce78e354 WatchSource:0}: Error finding container 7d250b85bb655e7f08772dc74ae5937b093a77d27942d57fe4725426ce78e354: Status 404 returned error can't find the container with id 7d250b85bb655e7f08772dc74ae5937b093a77d27942d57fe4725426ce78e354
Sep 16 13:30:56.956811 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.956788    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57"
Sep 16 13:30:56.957180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.957162    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd23045_d76e_4fbe_acdf_a186f3010925.slice/crio-0a46557235ccabcb67abff5fdc25b176eeed644c72823f3d9e56f75d613aa5d0 WatchSource:0}: Error finding container 0a46557235ccabcb67abff5fdc25b176eeed644c72823f3d9e56f75d613aa5d0: Status 404 returned error can't find the container with id 0a46557235ccabcb67abff5fdc25b176eeed644c72823f3d9e56f75d613aa5d0
Sep 16 13:30:56.965156 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.965132    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f513feb_83d6_498f_9ac9_cb5992a17049.slice/crio-9be63fdb29f977272302caaa4b4b0b938caa5421d036edc611cb76aaa62dbc07 WatchSource:0}: Error finding container 9be63fdb29f977272302caaa4b4b0b938caa5421d036edc611cb76aaa62dbc07: Status 404 returned error can't find the container with id 9be63fdb29f977272302caaa4b4b0b938caa5421d036edc611cb76aaa62dbc07
Sep 16 13:30:56.979594 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.979576    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mjcf8"
Sep 16 13:30:56.987483 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:56.987457    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b054665_a613_4bcb_a491_3a7c879297ae.slice/crio-5a8ca43ea326a0152b139a199e9c58206fb9d60dd0ce2541736ee9d2a8879182 WatchSource:0}: Error finding container 5a8ca43ea326a0152b139a199e9c58206fb9d60dd0ce2541736ee9d2a8879182: Status 404 returned error can't find the container with id 5a8ca43ea326a0152b139a199e9c58206fb9d60dd0ce2541736ee9d2a8879182
Sep 16 13:30:56.997999 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:56.997977    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dccn"
Sep 16 13:30:57.006095 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:57.006073    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0723d64e_668f_43fa_af2d_02f4cf0d5872.slice/crio-cdb50f5337334ab4c1f8c1f5c7800f4649960415e2bf4df1b7bbea752fb7f743 WatchSource:0}: Error finding container cdb50f5337334ab4c1f8c1f5c7800f4649960415e2bf4df1b7bbea752fb7f743: Status 404 returned error can't find the container with id cdb50f5337334ab4c1f8c1f5c7800f4649960415e2bf4df1b7bbea752fb7f743
Sep 16 13:30:57.013606 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.013588    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:30:57.015487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.015469    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:30:57.022749 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.022728    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc"
Sep 16 13:30:57.023169 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:57.023148    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2dc6ee0_6238_4905_91b8_e77664b202bf.slice/crio-d4e757948ec073ae3cf2b2851336b827218efd0d9fd3a33281e3def7611952d5 WatchSource:0}: Error finding container d4e757948ec073ae3cf2b2851336b827218efd0d9fd3a33281e3def7611952d5: Status 404 returned error can't find the container with id d4e757948ec073ae3cf2b2851336b827218efd0d9fd3a33281e3def7611952d5
Sep 16 13:30:57.031349 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:30:57.031328    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449851ae_d2f3_43eb_a483_b61c76b7b172.slice/crio-16fb6013366f77de8161289b4c80eee472f96c69487f185c7ae5052f48462f37 WatchSource:0}: Error finding container 16fb6013366f77de8161289b4c80eee472f96c69487f185c7ae5052f48462f37: Status 404 returned error can't find the container with id 16fb6013366f77de8161289b4c80eee472f96c69487f185c7ae5052f48462f37
Sep 16 13:30:57.033474 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.033451    2552 kuberuntime_manager.go:1459] "Unhandled Error" err="container tuned start failed in pod tuned-kqwdc_openshift-cluster-node-tuning-operator(449851ae-d2f3-43eb-a483-b61c76b7b172): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 16 13:30:57.033544 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.033488    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc" podUID="449851ae-d2f3-43eb-a483-b61c76b7b172"
Sep 16 13:30:57.292369 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.292277    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:57.292369 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.292326    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:57.292608 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.292461    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:30:57.292608 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.292465    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:30:57.292608 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.292520    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:30:58.292502482 +0000 UTC m=+3.046192585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:30:57.292608 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.292537    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:30:58.292529396 +0000 UTC m=+3.046219496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:30:57.378517 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.378485    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:30:57.392953 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.392924    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:30:57.393172 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.393149    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:30:57.393268 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.393180    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:30:57.393268 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.393196    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:30:57.393268 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.393261    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:30:58.393241575 +0000 UTC m=+3.146931680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:30:57.637707 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.637597    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 13:25:57 +0000 UTC" deadline="2028-02-16 12:13:47.968192642 +0000 UTC"
Sep 16 13:30:57.637707 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.637657    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12430h42m50.330539308s"
Sep 16 13:30:57.834577 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.834535    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:57.834776 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.834691    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:30:57.859504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.859434    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc" event={"ID":"449851ae-d2f3-43eb-a483-b61c76b7b172","Type":"ContainerStarted","Data":"16fb6013366f77de8161289b4c80eee472f96c69487f185c7ae5052f48462f37"}
Sep 16 13:30:57.862291 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:57.862256    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc" podUID="449851ae-d2f3-43eb-a483-b61c76b7b172"
Sep 16 13:30:57.881486 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.881451    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57" event={"ID":"1f513feb-83d6-498f-9ac9-cb5992a17049","Type":"ContainerStarted","Data":"9be63fdb29f977272302caaa4b4b0b938caa5421d036edc611cb76aaa62dbc07"}
Sep 16 13:30:57.905121 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.905039    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gdt8m" event={"ID":"c5ce7a17-adf6-4b5c-aa92-cee2f739c323","Type":"ContainerStarted","Data":"dd46ad403583236337b42846762a09bd58363ac1d43fa0889e2337a6df085a22"}
Sep 16 13:30:57.935662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.935608    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n67hz" event={"ID":"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1","Type":"ContainerStarted","Data":"5e20b5000dd32cc941d868dea90a59221fa83d8d4c1583a07fc5c5fc2bd2a68c"}
Sep 16 13:30:57.956390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.956347    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" event={"ID":"e413a23ab9533a4b31565bf83d28336b","Type":"ContainerStarted","Data":"7238290b6c6ae932336e0e3e994e0714dfbc74bec5c453a06676aa7fb3cddc98"}
Sep 16 13:30:57.971925 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.971889    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" event={"ID":"bb68f00172f0a347af69ef95526d7c0e","Type":"ContainerStarted","Data":"57675589c85007d14f5b25236e394f9d5c034a287555b8b26f1c5896eb47ce98"}
Sep 16 13:30:57.997655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:57.996366    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"d4e757948ec073ae3cf2b2851336b827218efd0d9fd3a33281e3def7611952d5"}
Sep 16 13:30:58.009844 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.009811    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dccn" event={"ID":"0723d64e-668f-43fa-af2d-02f4cf0d5872","Type":"ContainerStarted","Data":"cdb50f5337334ab4c1f8c1f5c7800f4649960415e2bf4df1b7bbea752fb7f743"}
Sep 16 13:30:58.023423 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.023388    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mjcf8" event={"ID":"3b054665-a613-4bcb-a491-3a7c879297ae","Type":"ContainerStarted","Data":"5a8ca43ea326a0152b139a199e9c58206fb9d60dd0ce2541736ee9d2a8879182"}
Sep 16 13:30:58.043291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.043256    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerStarted","Data":"0a46557235ccabcb67abff5fdc25b176eeed644c72823f3d9e56f75d613aa5d0"}
Sep 16 13:30:58.057756 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.057727    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9nwh" event={"ID":"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847","Type":"ContainerStarted","Data":"7d250b85bb655e7f08772dc74ae5937b093a77d27942d57fe4725426ce78e354"}
Sep 16 13:30:58.300428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.300339    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:58.300428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.300424    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:58.300661 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.300569    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:30:58.300661 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.300656    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:31:00.300634831 +0000 UTC m=+5.054324933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:30:58.301107 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.301086    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:30:58.301204 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.301148    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:00.301131311 +0000 UTC m=+5.054821416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:30:58.401299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.401251    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:30:58.401498 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.401458    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:30:58.401498 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.401488    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:30:58.401656 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.401502    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:30:58.401656 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.401556    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:31:00.401542915 +0000 UTC m=+5.155233015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:30:58.639014 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.638795    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 13:25:57 +0000 UTC" deadline="2028-03-25 03:36:18.812624909 +0000 UTC"
Sep 16 13:30:58.639014 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.638859    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13334h5m20.173770448s"
Sep 16 13:30:58.729126 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.729090    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 13:30:58.831681 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.831648    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:30:58.831873 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.831843    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:30:58.832303 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:58.832258    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:30:58.832429 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:58.832354    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:30:59.833244 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:30:59.833214    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:30:59.833745 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:30:59.833368    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:00.319291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:00.319209    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:00.319454 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:00.319287    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:00.319454 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.319418    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:00.319555 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.319484    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:04.31946501 +0000 UTC m=+9.073155114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:00.320026 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.319930    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:00.320026 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.319992    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:31:04.319974993 +0000 UTC m=+9.073665111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:00.420734 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:00.420523    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:00.420890 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.420795    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:31:00.420890 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.420823    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:31:00.420890 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.420839    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:00.421040 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.420903    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:31:04.420884826 +0000 UTC m=+9.174574942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:00.831890 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:00.831851    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:00.832044 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:00.831857    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:00.832044 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.831978    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:00.832141 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:00.832048    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:01.831719 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:01.831682    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:01.832154 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:01.831841    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:02.831237 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:02.831197    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:02.831437 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:02.831255    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:02.831437 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:02.831339    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:02.831578 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:02.831474    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:03.832483 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:03.832410    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:03.833254 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:03.832577    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:04.355505 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:04.355469    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:04.355686 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:04.355553    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:04.355686 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.355650    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:04.355833 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.355711    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:04.355833 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.355719    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:31:12.355696795 +0000 UTC m=+17.109386914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:04.355833 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.355767    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:12.355750383 +0000 UTC m=+17.109440508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:04.457525 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:04.456912    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:04.457525 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.457068    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:31:04.457525 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.457093    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:31:04.457525 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.457106    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:04.457525 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.457164    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:31:12.457145595 +0000 UTC m=+17.210835701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:04.832109 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:04.832079    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:04.832298 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.832192    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:04.832298 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:04.832253    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:04.832416 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:04.832376    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:05.832867 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:05.832832    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:05.833347 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:05.832970    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:06.831469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:06.831369    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:06.831469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:06.831424    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:06.831695 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:06.831536    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:06.831758 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:06.831687    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:07.831512 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:07.831476    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:07.832089 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:07.831625    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:08.831627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:08.831592    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:08.832051 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:08.831592    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:08.832051 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:08.831701    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:08.832051 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:08.831821    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:09.831588 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:09.831558    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:09.831764 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:09.831688    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:10.831524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:10.831491    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:10.831524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:10.831522    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:10.831781 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:10.831748    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:10.832165 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:10.831866    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:11.831533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:11.831497    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:11.831722 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:11.831643    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:12.421961 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:12.421925    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:12.422409 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:12.421996    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:12.422409 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.422102    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:12.422409 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.422129    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:12.422409 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.422185    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:28.422170403 +0000 UTC m=+33.175860507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:12.422409 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.422199    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:31:28.422192749 +0000 UTC m=+33.175882848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:12.523340 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:12.523306    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:12.523539 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.523453    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:31:12.523539 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.523478    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:31:12.523539 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.523490    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:12.523679 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.523553    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:31:28.523526734 +0000 UTC m=+33.277216833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:12.831468 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:12.831395    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:12.831654 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:12.831396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:12.831654 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.831502    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:12.831654 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:12.831616    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:13.831488 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:13.831460    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:13.831780 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:13.831575    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:14.831417 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:14.831247    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:14.831705 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:14.831530    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:14.831705 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:14.831382    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:14.832427 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:14.831768    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:15.096215 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.096135    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" event={"ID":"e413a23ab9533a4b31565bf83d28336b","Type":"ContainerStarted","Data":"0eaaf3e07fef1f12c4b0acc750236e91e9a14ffcac0c8af6ce7c920bbba88d9b"}
Sep 16 13:31:15.097596 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.097574    2552 generic.go:356] "Generic (PLEG): container finished" podID="bb68f00172f0a347af69ef95526d7c0e" containerID="f085fe3bba59d447af2e17498065fcf18aa69ecad371def0ac1c8fcd92803a5c" exitCode=0
Sep 16 13:31:15.097688 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.097652    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" event={"ID":"bb68f00172f0a347af69ef95526d7c0e","Type":"ContainerDied","Data":"f085fe3bba59d447af2e17498065fcf18aa69ecad371def0ac1c8fcd92803a5c"}
Sep 16 13:31:15.100665 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.100648    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:31:15.101054 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101034    2552 generic.go:356] "Generic (PLEG): container finished" podID="a2dc6ee0-6238-4905-91b8-e77664b202bf" containerID="9f01b0758f46b1ba881cdf3db3faa0984afb96c98ce150d327156c430f6b0b18" exitCode=1
Sep 16 13:31:15.101141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101101    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"d5433e4108210ee8a25ea12bbb4d83e62c4f9da0b9c4d9ea4d496e65d5e344b2"}
Sep 16 13:31:15.101195 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101157    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"0a85edf8269efcf351ce0fa2a4151224d3408ff423830e7f44da758b041b8ae8"}
Sep 16 13:31:15.101195 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101187    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"9f8c04b2ff31f4373cd3158de3631af3545152e9b90fc4554ef2de452029ea44"}
Sep 16 13:31:15.101313 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101221    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"0bb3cefd99c3c13d2bb6d2ecfa4902f531982bd61b7866e94b00105b64e2ffad"}
Sep 16 13:31:15.101313 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101265    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerDied","Data":"9f01b0758f46b1ba881cdf3db3faa0984afb96c98ce150d327156c430f6b0b18"}
Sep 16 13:31:15.101450 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.101313    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"0bca5256cee40fd70c101fe0b1b22123523ae0f9b8f1daee53de2d916e2018e3"}
Sep 16 13:31:15.102551 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.102509    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dccn" event={"ID":"0723d64e-668f-43fa-af2d-02f4cf0d5872","Type":"ContainerStarted","Data":"ffa0715631adfc0ca28c53a6683758d2bc823f83ab41fb4e7d9710b78653d0a8"}
Sep 16 13:31:15.104275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.104237    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mjcf8" event={"ID":"3b054665-a613-4bcb-a491-3a7c879297ae","Type":"ContainerStarted","Data":"39084393a70d66ad855cbbbe34d23ad305980d6d994fde49628ea09772917201"}
Sep 16 13:31:15.106392 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.106362    2552 generic.go:356] "Generic (PLEG): container finished" podID="0dd23045-d76e-4fbe-acdf-a186f3010925" containerID="dda956d0e94f488c22eef10000c72a5a76efa73ab65d228cf1d35cd1188371b2" exitCode=0
Sep 16 13:31:15.106489 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.106446    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerDied","Data":"dda956d0e94f488c22eef10000c72a5a76efa73ab65d228cf1d35cd1188371b2"}
Sep 16 13:31:15.108235 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.108211    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57" event={"ID":"1f513feb-83d6-498f-9ac9-cb5992a17049","Type":"ContainerStarted","Data":"899cf2c7cc4532696fd132696cf5ab39bcfdbbd38a57891b7933a0ed9c52f2e2"}
Sep 16 13:31:15.109917 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.109894    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gdt8m" event={"ID":"c5ce7a17-adf6-4b5c-aa92-cee2f739c323","Type":"ContainerStarted","Data":"016c95cc207c419f60c1a22b804a170ab17c8732a96d2d559951caeedd68ca3e"}
Sep 16 13:31:15.111712 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.111689    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n67hz" event={"ID":"aa33aaef-f00a-4bd4-995a-c695a7ab5cf1","Type":"ContainerStarted","Data":"5cd1c991cf3ab1a0c6f2fe42515f395757f51e263d34857aa436389f9ef235c3"}
Sep 16 13:31:15.114314 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.114279    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-205.ec2.internal" podStartSLOduration=18.114263084 podStartE2EDuration="18.114263084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:15.11332986 +0000 UTC m=+19.867019984" watchObservedRunningTime="2026-09-16 13:31:15.114263084 +0000 UTC m=+19.867953210"
Sep 16 13:31:15.133735 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.133694    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mjcf8" podStartSLOduration=1.635248931 podStartE2EDuration="19.133681192s" totalImagesPullingTime="17.498432261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:15.133365937 +0000 UTC m=+19.887056066" watchObservedRunningTime="2026-09-16 13:31:15.133681192 +0000 UTC m=+19.887371335"
Sep 16 13:31:15.167496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.167462    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n67hz" podStartSLOduration=2.13490081 podStartE2EDuration="19.167447643s" totalImagesPullingTime="17.032546833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:15.167216299 +0000 UTC m=+19.920906422" watchObservedRunningTime="2026-09-16 13:31:15.167447643 +0000 UTC m=+19.921137766"
Sep 16 13:31:15.168007 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.167894    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7dccn" podStartSLOduration=2.199405463 podStartE2EDuration="19.167881383s" totalImagesPullingTime="16.96847592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:15.149753716 +0000 UTC m=+19.903443838" watchObservedRunningTime="2026-09-16 13:31:15.167881383 +0000 UTC m=+19.921571505"
Sep 16 13:31:15.244424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.244383    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gdt8m" podStartSLOduration=2.187896762 podStartE2EDuration="19.244366244s" totalImagesPullingTime="17.056469482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:15.243951952 +0000 UTC m=+19.997642084" watchObservedRunningTime="2026-09-16 13:31:15.244366244 +0000 UTC m=+19.998056364"
Sep 16 13:31:15.832914 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.832885    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:15.833312 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:15.832978    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:15.869372 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:15.869266    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 13:31:16.116232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.116152    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9nwh" event={"ID":"488f2f54-1fdd-4f64-b5ec-95ad3f7e6847","Type":"ContainerStarted","Data":"3cd9dba142aff23ee01370cea5c9dc2e2bf73c8a0f10227570eae0f7b673b4be"}
Sep 16 13:31:16.118785 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.118755    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57" event={"ID":"1f513feb-83d6-498f-9ac9-cb5992a17049","Type":"ContainerStarted","Data":"c371af2240e5b2f40d2dd4fddc0e4b983c2ad82a1de5fa82b105a861e70d6688"}
Sep 16 13:31:16.121096 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.121070    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" event={"ID":"bb68f00172f0a347af69ef95526d7c0e","Type":"ContainerStarted","Data":"1a75ced648e4f952cc2cefbbcb538a09cb8a9604dfb81c34cc7e08c8dcfa16ed"}
Sep 16 13:31:16.149749 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.149705    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-205.ec2.internal" podStartSLOduration=19.149691667 podStartE2EDuration="19.149691667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:16.149352268 +0000 UTC m=+20.903042402" watchObservedRunningTime="2026-09-16 13:31:16.149691667 +0000 UTC m=+20.903381787"
Sep 16 13:31:16.150364 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.150323    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g9nwh" podStartSLOduration=3.111670535 podStartE2EDuration="20.150312073s" totalImagesPullingTime="17.038641538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:16.133130641 +0000 UTC m=+20.886820774" watchObservedRunningTime="2026-09-16 13:31:16.150312073 +0000 UTC m=+20.904002193"
Sep 16 13:31:16.792513 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.792421    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T13:31:15.869285186Z","UUID":"e9bdb3de-fbe4-429b-a3c6-9ab22190ca4e","Handler":null,"Name":"","Endpoint":""}
Sep 16 13:31:16.798257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.795624    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 13:31:16.798257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.795667    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 13:31:16.831213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.831135    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:16.831323 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:16.831243    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:16.831323 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:16.831280    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:16.831437 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:16.831359    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:17.126856 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:17.126769    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57" event={"ID":"1f513feb-83d6-498f-9ac9-cb5992a17049","Type":"ContainerStarted","Data":"a0e269c63bcc3525c676942b13b0fe83ce4997e25b3413c590ae7c51c9b0108c"}
Sep 16 13:31:17.131143 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:17.131117    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:31:17.131758 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:17.131727    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"3d1bab327d1c133831d5989345144604a8c79698549468afeec27d3313ef4f0b"}
Sep 16 13:31:17.153908 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:17.153813    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrm57" podStartSLOduration=2.305394918 podStartE2EDuration="21.153792206s" totalImagesPullingTime="18.848397288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:17.152413864 +0000 UTC m=+21.906103998" watchObservedRunningTime="2026-09-16 13:31:17.153792206 +0000 UTC m=+21.907482327"
Sep 16 13:31:17.831799 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:17.831760    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:17.831976 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:17.831910    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:18.832105 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:18.832072    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:18.832105 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:18.832088    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:18.832625 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:18.832184    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:18.832625 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:18.832323    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:19.649630 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:19.649594    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:31:19.650176 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:19.650153    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:31:19.831905 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:19.831874    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:19.832081 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:19.831999    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:20.139169 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:20.139091    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:31:20.139662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:20.139643    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gdt8m"
Sep 16 13:31:20.831590 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:20.831560    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:20.831590 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:20.831595    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:20.831767 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:20.831663    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:20.831803 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:20.831768    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:21.142938 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:21.142669    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc" event={"ID":"449851ae-d2f3-43eb-a483-b61c76b7b172","Type":"ContainerStarted","Data":"22419aa0e8eedbbfa49e369782d689657d28eeaaa41610cb571f70d38d4f8e14"}
Sep 16 13:31:21.146939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:21.146686    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:31:21.147260 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:21.147098    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"071a8fb79dff2b4717194af310f57047ddba23159b6c37efae75868cde4c4b7c"}
Sep 16 13:31:21.147678 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:21.147603    2552 scope.go:117] "RemoveContainer" containerID="9f01b0758f46b1ba881cdf3db3faa0984afb96c98ce150d327156c430f6b0b18"
Sep 16 13:31:21.170182 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:21.170146    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kqwdc" podStartSLOduration=1.215060285 podStartE2EDuration="25.170131311s" totalImagesPullingTime="23.955071026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-16 13:31:21.169497239 +0000 UTC m=+25.923187370" watchObservedRunningTime="2026-09-16 13:31:21.170131311 +0000 UTC m=+25.923821432"
Sep 16 13:31:21.832027 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:21.831999    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:21.832164 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:21.832100    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:22.152469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.152401    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:31:22.153065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.152773    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" event={"ID":"a2dc6ee0-6238-4905-91b8-e77664b202bf","Type":"ContainerStarted","Data":"e440c38e3519b9f72916e9b2a7a79e46d6941bedbde59a9700ded8e5c0070551"}
Sep 16 13:31:22.153065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.152833    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 13:31:22.153192 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.153157    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:31:22.153246 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.153236    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:31:22.154871 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.154845    2552 generic.go:356] "Generic (PLEG): container finished" podID="0dd23045-d76e-4fbe-acdf-a186f3010925" containerID="f88d8411cb8ceca2301ab07d9f4e6da96ead6166333d77053003a3c8f3186189" exitCode=0
Sep 16 13:31:22.155002 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.154921    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerDied","Data":"f88d8411cb8ceca2301ab07d9f4e6da96ead6166333d77053003a3c8f3186189"}
Sep 16 13:31:22.168488 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.168472    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:31:22.168588 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.168576    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:31:22.193350 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.192690    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf" podStartSLOduration=9.20678683 podStartE2EDuration="26.192672735s" totalImagesPullingTime="16.985885905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:22.191019448 +0000 UTC m=+26.944709566" watchObservedRunningTime="2026-09-16 13:31:22.192672735 +0000 UTC m=+26.946362858"
Sep 16 13:31:22.831307 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.831279    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:22.831459 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:22.831398    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:22.831520 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:22.831459    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:22.831624 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:22.831602    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:23.084273 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.084196    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kzns5"]
Sep 16 13:31:23.087377 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.087350    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgjgf"]
Sep 16 13:31:23.097422 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.097400    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bm6k9"]
Sep 16 13:31:23.097523 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.097505    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:23.097632 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:23.097612    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:23.157509 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.157486    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:23.157995 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.157534    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 13:31:23.157995 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:23.157486    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:23.157995 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:23.157608    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:23.157995 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:23.157679    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:24.160295 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:24.160155    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 13:31:24.831152 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:24.831123    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:24.831307 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:24.831223    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:24.831307 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:24.831250    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:24.831307 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:24.831241    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:24.831447 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:24.831406    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:24.831561 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:24.831491    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:25.163927 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:25.163850    2552 generic.go:356] "Generic (PLEG): container finished" podID="0dd23045-d76e-4fbe-acdf-a186f3010925" containerID="7168952f433a9e6a149fee4ac44dc5ec3fb21a33479d3d6b994640c1e8afeac3" exitCode=0
Sep 16 13:31:25.163927 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:25.163909    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerDied","Data":"7168952f433a9e6a149fee4ac44dc5ec3fb21a33479d3d6b994640c1e8afeac3"}
Sep 16 13:31:25.741874 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:25.741844    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:31:26.168457 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.168379    2552 generic.go:356] "Generic (PLEG): container finished" podID="0dd23045-d76e-4fbe-acdf-a186f3010925" containerID="48d0af700de929b84ec7ebefe15340f115dcd735cea272b87d69a403d4097dd5" exitCode=0
Sep 16 13:31:26.168457 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.168422    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerDied","Data":"48d0af700de929b84ec7ebefe15340f115dcd735cea272b87d69a403d4097dd5"}
Sep 16 13:31:26.831699 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.831665    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:26.831865 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.831665    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:26.831865 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:26.831785    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bm6k9" podUID="8f057a5b-7478-4edf-95db-99245dd6bf3e"
Sep 16 13:31:26.831865 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.831665    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:26.831865 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:26.831853    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kzns5" podUID="8895c9fb-6858-4e65-8026-7bfe790ae660"
Sep 16 13:31:26.832021 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:26.831960    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgjgf" podUID="3c787123-1043-4e56-9034-cfe432a748cf"
Sep 16 13:31:26.982062 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.982039    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-205.ec2.internal" event="NodeReady"
Sep 16 13:31:26.982192 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:26.982180    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 13:31:27.034941 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.034904    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4f4bs"]
Sep 16 13:31:27.038796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.038777    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tf9nf"]
Sep 16 13:31:27.038944 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.038920    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.041867 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.041848    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.042313 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.042290    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 13:31:27.042383 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.042363    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 13:31:27.042583 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.042567    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t4m6m\""
Sep 16 13:31:27.044846 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.044825    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 13:31:27.045187 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.045032    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 13:31:27.045286 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.045267    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 13:31:27.045632 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.045468    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jfkh\""
Sep 16 13:31:27.046192 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.046172    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tf9nf"]
Sep 16 13:31:27.048841 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.048821    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4f4bs"]
Sep 16 13:31:27.125790 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.125722    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmlj4\" (UniqueName: \"kubernetes.io/projected/f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e-kube-api-access-qmlj4\") pod \"ingress-canary-tf9nf\" (UID: \"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e\") " pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.125790 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.125774    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.125970 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.125794    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478a32c9-7492-4522-b9da-e91cf99cf25a-tmp-dir\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.125970 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.125841    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e-cert\") pod \"ingress-canary-tf9nf\" (UID: \"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e\") " pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.125970 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.125878    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7mk8\" (UniqueName: \"kubernetes.io/projected/478a32c9-7492-4522-b9da-e91cf99cf25a-kube-api-access-k7mk8\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.125970 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.125943    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478a32c9-7492-4522-b9da-e91cf99cf25a-config-volume\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.227155 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227126    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227163    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478a32c9-7492-4522-b9da-e91cf99cf25a-tmp-dir\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227194    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e-cert\") pod \"ingress-canary-tf9nf\" (UID: \"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e\") " pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227219    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7mk8\" (UniqueName: \"kubernetes.io/projected/478a32c9-7492-4522-b9da-e91cf99cf25a-kube-api-access-k7mk8\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:27.227292    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:27.227378    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls podName:478a32c9-7492-4522-b9da-e91cf99cf25a nodeName:}" failed. No retries permitted until 2026-09-16 13:31:27.727358649 +0000 UTC m=+32.481048763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls") pod "dns-default-4f4bs" (UID: "478a32c9-7492-4522-b9da-e91cf99cf25a") : secret "dns-default-metrics-tls" not found
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227493    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478a32c9-7492-4522-b9da-e91cf99cf25a-config-volume\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.227605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227566    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmlj4\" (UniqueName: \"kubernetes.io/projected/f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e-kube-api-access-qmlj4\") pod \"ingress-canary-tf9nf\" (UID: \"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e\") " pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.227930 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.227561    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478a32c9-7492-4522-b9da-e91cf99cf25a-tmp-dir\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.229509 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.228577    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/478a32c9-7492-4522-b9da-e91cf99cf25a-config-volume\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.232758 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.232731    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e-cert\") pod \"ingress-canary-tf9nf\" (UID: \"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e\") " pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.238463 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.238439    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7mk8\" (UniqueName: \"kubernetes.io/projected/478a32c9-7492-4522-b9da-e91cf99cf25a-kube-api-access-k7mk8\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.238610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.238445    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmlj4\" (UniqueName: \"kubernetes.io/projected/f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e-kube-api-access-qmlj4\") pod \"ingress-canary-tf9nf\" (UID: \"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e\") " pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.357815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.357783    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tf9nf"
Sep 16 13:31:27.661143 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.661116    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tf9nf"]
Sep 16 13:31:27.664478 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:27.664453    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f0ba5e_18be_4b34_9d17_d6b40a2edf4e.slice/crio-f697f693b652329759bdfb3f512a6b33d83c0aaa2acac7e6a88bd5a3f422a7f4 WatchSource:0}: Error finding container f697f693b652329759bdfb3f512a6b33d83c0aaa2acac7e6a88bd5a3f422a7f4: Status 404 returned error can't find the container with id f697f693b652329759bdfb3f512a6b33d83c0aaa2acac7e6a88bd5a3f422a7f4
Sep 16 13:31:27.732288 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:27.732201    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:27.732420 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:27.732314    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:31:27.732420 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:27.732374    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls podName:478a32c9-7492-4522-b9da-e91cf99cf25a nodeName:}" failed. No retries permitted until 2026-09-16 13:31:28.732356998 +0000 UTC m=+33.486047105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls") pod "dns-default-4f4bs" (UID: "478a32c9-7492-4522-b9da-e91cf99cf25a") : secret "dns-default-metrics-tls" not found
Sep 16 13:31:28.019198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.019117    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m2p2d"]
Sep 16 13:31:28.052904 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.052874    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m2p2d"]
Sep 16 13:31:28.053073 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.053008    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.055848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.055821    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 13:31:28.055848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.055844    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 13:31:28.056116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.056085    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 13:31:28.056116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.056108    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 13:31:28.057269 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.057250    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7rd5w\""
Sep 16 13:31:28.135687 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.135661    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/966482cc-216c-470c-9e41-65c04b936809-data-volume\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.135870 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.135709    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppp5k\" (UniqueName: \"kubernetes.io/projected/966482cc-216c-470c-9e41-65c04b936809-kube-api-access-ppp5k\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.135870 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.135769    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/966482cc-216c-470c-9e41-65c04b936809-crio-socket\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.135870 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.135792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.135870 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.135832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.175723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.175680    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tf9nf" event={"ID":"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e","Type":"ContainerStarted","Data":"f697f693b652329759bdfb3f512a6b33d83c0aaa2acac7e6a88bd5a3f422a7f4"}
Sep 16 13:31:28.237245 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.237204    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/966482cc-216c-470c-9e41-65c04b936809-crio-socket\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.237662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.237254    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.237662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.237311    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.237662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.237371    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/966482cc-216c-470c-9e41-65c04b936809-data-volume\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.237662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.237415    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppp5k\" (UniqueName: \"kubernetes.io/projected/966482cc-216c-470c-9e41-65c04b936809-kube-api-access-ppp5k\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.237911 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.237886    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/966482cc-216c-470c-9e41-65c04b936809-crio-socket\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.238018 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.237998    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:31:28.238070 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.238019    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:28.238115 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.238070    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:28.738051462 +0000 UTC m=+33.491741561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:28.238115 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.238110    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:28.738085357 +0000 UTC m=+33.491775456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : configmap "kube-rbac-proxy" not found
Sep 16 13:31:28.238233 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.238220    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/966482cc-216c-470c-9e41-65c04b936809-data-volume\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.247706 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.247675    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppp5k\" (UniqueName: \"kubernetes.io/projected/966482cc-216c-470c-9e41-65c04b936809-kube-api-access-ppp5k\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.438880 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.438795    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:28.439043 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.438874    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:28.439043 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.439000    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:28.439043 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.439020    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:28.439200 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.439065    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs podName:8f057a5b-7478-4edf-95db-99245dd6bf3e nodeName:}" failed. No retries permitted until 2026-09-16 13:32:00.439046759 +0000 UTC m=+65.192736865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs") pod "network-metrics-daemon-bm6k9" (UID: "8f057a5b-7478-4edf-95db-99245dd6bf3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 13:31:28.439200 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.439082    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret podName:8895c9fb-6858-4e65-8026-7bfe790ae660 nodeName:}" failed. No retries permitted until 2026-09-16 13:32:00.439072529 +0000 UTC m=+65.192762628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret") pod "global-pull-secret-syncer-kzns5" (UID: "8895c9fb-6858-4e65-8026-7bfe790ae660") : object "kube-system"/"original-pull-secret" not registered
Sep 16 13:31:28.539953 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.539920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:28.540128 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.540103    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 13:31:28.540128 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.540123    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 13:31:28.540241 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.540136    2552 projected.go:196] Error preparing data for projected volume kube-api-access-mzn55 for pod openshift-network-diagnostics/network-check-target-kgjgf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:28.540241 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.540211    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55 podName:3c787123-1043-4e56-9034-cfe432a748cf nodeName:}" failed. No retries permitted until 2026-09-16 13:32:00.540178316 +0000 UTC m=+65.293868425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mzn55" (UniqueName: "kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55") pod "network-check-target-kgjgf" (UID: "3c787123-1043-4e56-9034-cfe432a748cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 13:31:28.742510 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.742424    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.742510 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.742478    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.742513    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.742606    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.742647    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.742661    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.742681    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:29.742661395 +0000 UTC m=+34.496351497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.742703    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:29.742687889 +0000 UTC m=+34.496378011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : configmap "kube-rbac-proxy" not found
Sep 16 13:31:28.742735 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:28.742720    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls podName:478a32c9-7492-4522-b9da-e91cf99cf25a nodeName:}" failed. No retries permitted until 2026-09-16 13:31:30.742711387 +0000 UTC m=+35.496401490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls") pod "dns-default-4f4bs" (UID: "478a32c9-7492-4522-b9da-e91cf99cf25a") : secret "dns-default-metrics-tls" not found
Sep 16 13:31:28.832806 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.831419    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:31:28.832806 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.831888    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:31:28.832806 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.832270    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:31:28.834714 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.834688    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 13:31:28.835215 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.835196    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 13:31:28.835739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.835717    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 13:31:28.835739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.835731    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 13:31:28.836274 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.836254    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4nxp8\""
Sep 16 13:31:28.836362 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:28.836294    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4n8lp\""
Sep 16 13:31:29.751304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:29.751270    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:29.751715 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:29.751336    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:29.751715 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:29.751415    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:29.751715 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:29.751444    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 13:31:29.751715 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:29.751505    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:31.75148131 +0000 UTC m=+36.505171430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:29.751715 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:29.751527    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:31.751519519 +0000 UTC m=+36.505209632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : configmap "kube-rbac-proxy" not found
Sep 16 13:31:30.070873 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.070842    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n67hz_aa33aaef-f00a-4bd4-995a-c695a7ab5cf1/dns-node-resolver/0.log"
Sep 16 13:31:30.554616 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.554583    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-66f5l"]
Sep 16 13:31:30.572803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.572782    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-66f5l"]
Sep 16 13:31:30.572946 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.572874    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.576201 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.576172    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 13:31:30.576321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.576221    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 13:31:30.577323 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.577302    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tfnsc\""
Sep 16 13:31:30.577451 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.577370    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 13:31:30.577703 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.577684    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 13:31:30.660237 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.660208    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d655b53-a303-4a23-8983-75a141b81dcb-signing-key\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.660406 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.660261    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d655b53-a303-4a23-8983-75a141b81dcb-signing-cabundle\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.660406 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.660286    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ck75\" (UniqueName: \"kubernetes.io/projected/8d655b53-a303-4a23-8983-75a141b81dcb-kube-api-access-8ck75\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.671513 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.671494    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dccn_0723d64e-668f-43fa-af2d-02f4cf0d5872/node-ca/0.log"
Sep 16 13:31:30.761102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.761073    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:30.761523 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.761106    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d655b53-a303-4a23-8983-75a141b81dcb-signing-key\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.761523 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:30.761242    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:31:30.761523 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.761270    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d655b53-a303-4a23-8983-75a141b81dcb-signing-cabundle\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.761523 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.761304    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ck75\" (UniqueName: \"kubernetes.io/projected/8d655b53-a303-4a23-8983-75a141b81dcb-kube-api-access-8ck75\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.761523 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:30.761325    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls podName:478a32c9-7492-4522-b9da-e91cf99cf25a nodeName:}" failed. No retries permitted until 2026-09-16 13:31:34.761304324 +0000 UTC m=+39.514994426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls") pod "dns-default-4f4bs" (UID: "478a32c9-7492-4522-b9da-e91cf99cf25a") : secret "dns-default-metrics-tls" not found
Sep 16 13:31:30.762047 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.762022    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d655b53-a303-4a23-8983-75a141b81dcb-signing-cabundle\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.763824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.763801    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d655b53-a303-4a23-8983-75a141b81dcb-signing-key\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.770882 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.770859    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ck75\" (UniqueName: \"kubernetes.io/projected/8d655b53-a303-4a23-8983-75a141b81dcb-kube-api-access-8ck75\") pod \"service-ca-568869fdc5-66f5l\" (UID: \"8d655b53-a303-4a23-8983-75a141b81dcb\") " pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:30.882785 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:30.882707    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-66f5l"
Sep 16 13:31:31.741751 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:31.741719    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-66f5l"]
Sep 16 13:31:31.758422 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:31.758394    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d655b53_a303_4a23_8983_75a141b81dcb.slice/crio-19c4bb415e62272d3f835f828737c3b2068acb3eafdab9b3f0ed16a5fe7f4a38 WatchSource:0}: Error finding container 19c4bb415e62272d3f835f828737c3b2068acb3eafdab9b3f0ed16a5fe7f4a38: Status 404 returned error can't find the container with id 19c4bb415e62272d3f835f828737c3b2068acb3eafdab9b3f0ed16a5fe7f4a38
Sep 16 13:31:31.768309 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:31.768285    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:31.768634 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:31.768336    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:31.768634 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:31.768483    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:31.768634 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:31.768584    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:35.768537751 +0000 UTC m=+40.522227872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:31.768883 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:31.768866    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/966482cc-216c-470c-9e41-65c04b936809-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:32.186944 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:32.186908    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-66f5l" event={"ID":"8d655b53-a303-4a23-8983-75a141b81dcb","Type":"ContainerStarted","Data":"19c4bb415e62272d3f835f828737c3b2068acb3eafdab9b3f0ed16a5fe7f4a38"}
Sep 16 13:31:32.189539 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:32.189511    2552 generic.go:356] "Generic (PLEG): container finished" podID="0dd23045-d76e-4fbe-acdf-a186f3010925" containerID="dbf7c29ba346326ee172edd2d44db91903af549e0870824075bab1aa1437cb1c" exitCode=0
Sep 16 13:31:32.189676 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:32.189599    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerDied","Data":"dbf7c29ba346326ee172edd2d44db91903af549e0870824075bab1aa1437cb1c"}
Sep 16 13:31:32.191100 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:32.191080    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tf9nf" event={"ID":"f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e","Type":"ContainerStarted","Data":"e1cd75215cfdffc8f2da29766154e658e88e42562a097898d48e8f93863bb094"}
Sep 16 13:31:32.237913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:32.237866    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tf9nf" podStartSLOduration=1.420142547 podStartE2EDuration="5.237847246s" totalImagesPullingTime="3.817704699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:32.236223869 +0000 UTC m=+36.989913990" watchObservedRunningTime="2026-09-16 13:31:32.237847246 +0000 UTC m=+36.991537368"
Sep 16 13:31:33.196880 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:33.196846    2552 generic.go:356] "Generic (PLEG): container finished" podID="0dd23045-d76e-4fbe-acdf-a186f3010925" containerID="741ea2369222c063d29c8f4ecd9b8f59632db923e073fd69e4f1d17d9fafad51" exitCode=0
Sep 16 13:31:33.197331 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:33.196928    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerDied","Data":"741ea2369222c063d29c8f4ecd9b8f59632db923e073fd69e4f1d17d9fafad51"}
Sep 16 13:31:34.202668 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:34.202640    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spfqx" event={"ID":"0dd23045-d76e-4fbe-acdf-a186f3010925","Type":"ContainerStarted","Data":"9e12606af80d7622822ce7bed4348296a67a7acadc6714ac0e3f9bcd035acfcd"}
Sep 16 13:31:34.227870 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:34.227817    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-spfqx" podStartSLOduration=7.502896337 podStartE2EDuration="38.227799333s" totalImagesPullingTime="30.724902996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:34.226283976 +0000 UTC m=+38.979974097" watchObservedRunningTime="2026-09-16 13:31:34.227799333 +0000 UTC m=+38.981489650"
Sep 16 13:31:34.794002 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:34.793973    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:34.794135 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:34.794098    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 13:31:34.794170 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:34.794150    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls podName:478a32c9-7492-4522-b9da-e91cf99cf25a nodeName:}" failed. No retries permitted until 2026-09-16 13:31:42.794137539 +0000 UTC m=+47.547827638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls") pod "dns-default-4f4bs" (UID: "478a32c9-7492-4522-b9da-e91cf99cf25a") : secret "dns-default-metrics-tls" not found
Sep 16 13:31:35.206220 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:35.206136    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-66f5l" event={"ID":"8d655b53-a303-4a23-8983-75a141b81dcb","Type":"ContainerStarted","Data":"0a770a9f197dd139b7add24e7cccf1f72a1aa65547f7e6612d58041feb754102"}
Sep 16 13:31:35.230756 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:35.230713    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-66f5l" podStartSLOduration=2.5178815070000002 podStartE2EDuration="5.230697248s" totalImagesPullingTime="2.712815741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:35.228977668 +0000 UTC m=+39.982667788" watchObservedRunningTime="2026-09-16 13:31:35.230697248 +0000 UTC m=+39.984387409"
Sep 16 13:31:35.800019 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:35.799988    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:35.800311 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:35.800138    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:35.800311 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:35.800207    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls podName:966482cc-216c-470c-9e41-65c04b936809 nodeName:}" failed. No retries permitted until 2026-09-16 13:31:43.8001898 +0000 UTC m=+48.553879920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m2p2d" (UID: "966482cc-216c-470c-9e41-65c04b936809") : secret "insights-runtime-extractor-tls" not found
Sep 16 13:31:42.847299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:42.847261    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:42.849565 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:42.849529    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/478a32c9-7492-4522-b9da-e91cf99cf25a-metrics-tls\") pod \"dns-default-4f4bs\" (UID: \"478a32c9-7492-4522-b9da-e91cf99cf25a\") " pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:42.952072 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:42.952045    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:43.224032 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:43.223945    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4f4bs"]
Sep 16 13:31:43.227376 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:43.227347    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478a32c9_7492_4522_b9da_e91cf99cf25a.slice/crio-50bf546048fd61476e7cfea84f9676d92af218d71a73d94adc225bfb9dc6510a WatchSource:0}: Error finding container 50bf546048fd61476e7cfea84f9676d92af218d71a73d94adc225bfb9dc6510a: Status 404 returned error can't find the container with id 50bf546048fd61476e7cfea84f9676d92af218d71a73d94adc225bfb9dc6510a
Sep 16 13:31:43.854988 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:43.854948    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:43.857719 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:43.857695    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/966482cc-216c-470c-9e41-65c04b936809-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m2p2d\" (UID: \"966482cc-216c-470c-9e41-65c04b936809\") " pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:43.964138 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:43.964106    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m2p2d"
Sep 16 13:31:44.229333 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:44.229264    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4f4bs" event={"ID":"478a32c9-7492-4522-b9da-e91cf99cf25a","Type":"ContainerStarted","Data":"50bf546048fd61476e7cfea84f9676d92af218d71a73d94adc225bfb9dc6510a"}
Sep 16 13:31:44.251098 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:44.251073    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m2p2d"]
Sep 16 13:31:45.236838 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:45.236761    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4f4bs" event={"ID":"478a32c9-7492-4522-b9da-e91cf99cf25a","Type":"ContainerStarted","Data":"2321634eb5da5f7e1b4be6e5f0e19af404e6d11ba631a59db070988b2c2852bd"}
Sep 16 13:31:45.236838 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:45.236829    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4f4bs" event={"ID":"478a32c9-7492-4522-b9da-e91cf99cf25a","Type":"ContainerStarted","Data":"0494d00c2fa1ef849a57f2f1d62c7814e221611c2c04c608bf36278b3fc18110"}
Sep 16 13:31:45.237269 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:45.236879    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:45.238295 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:45.238274    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2p2d" event={"ID":"966482cc-216c-470c-9e41-65c04b936809","Type":"ContainerStarted","Data":"1fb760cd30095cc371035cb889bf4dd92a8929f632815e0fb36f498aff84b2b2"}
Sep 16 13:31:45.238388 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:45.238312    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2p2d" event={"ID":"966482cc-216c-470c-9e41-65c04b936809","Type":"ContainerStarted","Data":"d7c65f91c7c15c30e958d9b9db1609d803dd1025c6e999cd95df7d34ce54a731"}
Sep 16 13:31:45.257662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:45.257624    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4f4bs" podStartSLOduration=16.650882436 podStartE2EDuration="18.257612822s" totalImagesPullingTime="1.606730386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:45.257187151 +0000 UTC m=+50.010877273" watchObservedRunningTime="2026-09-16 13:31:45.257612822 +0000 UTC m=+50.011302943"
Sep 16 13:31:46.243981 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:46.243944    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2p2d" event={"ID":"966482cc-216c-470c-9e41-65c04b936809","Type":"ContainerStarted","Data":"539ff2de59a2281cc65eb57a5c6af8e524228c0e2966d8573153488602a6bb74"}
Sep 16 13:31:47.248758 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:47.248729    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m2p2d" event={"ID":"966482cc-216c-470c-9e41-65c04b936809","Type":"ContainerStarted","Data":"6e6f72d2a545d7a1f062e99a0d1d0daf821f8b4facf201b7e4034ef4c31e6c1c"}
Sep 16 13:31:47.270772 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:47.270731    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m2p2d" podStartSLOduration=17.606558682 podStartE2EDuration="20.270716742s" totalImagesPullingTime="2.66415806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:31:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:47.269254685 +0000 UTC m=+52.022944806" watchObservedRunningTime="2026-09-16 13:31:47.270716742 +0000 UTC m=+52.024406862"
Sep 16 13:31:54.156105 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.156074    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"]
Sep 16 13:31:54.164540 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.164518    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.171245 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.171183    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 13:31:54.178814 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.178797    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 16 13:31:54.179111 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.179094    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 13:31:54.179201 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.179183    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 13:31:54.180508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.180482    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"]
Sep 16 13:31:54.181781 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.181759    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"]
Sep 16 13:31:54.183739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.183722    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.188970 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.188952    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n29hr\""
Sep 16 13:31:54.189893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.189865    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 13:31:54.204940 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.204917    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"]
Sep 16 13:31:54.222862 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.222839    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/299c8fea-10fb-4946-a439-778f47d15ab1-klusterlet-config\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.222946 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.222865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghd6q\" (UniqueName: \"kubernetes.io/projected/299c8fea-10fb-4946-a439-778f47d15ab1-kube-api-access-ghd6q\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.222946 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.222891    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4bf7dafb-c189-4a66-9a71-2c4ac40c6c30-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-567f6ccbb8-srngq\" (UID: \"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.222946 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.222906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4ls\" (UniqueName: \"kubernetes.io/projected/4bf7dafb-c189-4a66-9a71-2c4ac40c6c30-kube-api-access-jd4ls\") pod \"managed-serviceaccount-addon-agent-567f6ccbb8-srngq\" (UID: \"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.223054 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.222971    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299c8fea-10fb-4946-a439-778f47d15ab1-tmp\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.323417 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.323393    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/299c8fea-10fb-4946-a439-778f47d15ab1-klusterlet-config\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.323524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.323421    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghd6q\" (UniqueName: \"kubernetes.io/projected/299c8fea-10fb-4946-a439-778f47d15ab1-kube-api-access-ghd6q\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.323524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.323450    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4bf7dafb-c189-4a66-9a71-2c4ac40c6c30-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-567f6ccbb8-srngq\" (UID: \"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.323524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.323467    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4ls\" (UniqueName: \"kubernetes.io/projected/4bf7dafb-c189-4a66-9a71-2c4ac40c6c30-kube-api-access-jd4ls\") pod \"managed-serviceaccount-addon-agent-567f6ccbb8-srngq\" (UID: \"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.323524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.323486    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299c8fea-10fb-4946-a439-778f47d15ab1-tmp\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.323860 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.323843    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299c8fea-10fb-4946-a439-778f47d15ab1-tmp\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.326015 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.325997    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4bf7dafb-c189-4a66-9a71-2c4ac40c6c30-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-567f6ccbb8-srngq\" (UID: \"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.326191 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.326171    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/299c8fea-10fb-4946-a439-778f47d15ab1-klusterlet-config\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.344557 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.344529    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghd6q\" (UniqueName: \"kubernetes.io/projected/299c8fea-10fb-4946-a439-778f47d15ab1-kube-api-access-ghd6q\") pod \"klusterlet-addon-workmgr-64466f4fd4-jmqjn\" (UID: \"299c8fea-10fb-4946-a439-778f47d15ab1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.346032 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.346013    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55569c5dd9-n75sc"]
Sep 16 13:31:54.348323 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.348307    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.353989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.353969    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 13:31:54.354674 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.354658    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 13:31:54.356334 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.356321    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 13:31:54.356823 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.356810    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s4fpm\""
Sep 16 13:31:54.363871 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.363845    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4ls\" (UniqueName: \"kubernetes.io/projected/4bf7dafb-c189-4a66-9a71-2c4ac40c6c30-kube-api-access-jd4ls\") pod \"managed-serviceaccount-addon-agent-567f6ccbb8-srngq\" (UID: \"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.369370 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.369353    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 13:31:54.384440 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.384415    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55569c5dd9-n75sc"]
Sep 16 13:31:54.424320 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424269    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2p9\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-kube-api-access-cj2p9\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424320 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424316    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5524210f-2353-4e38-8d9e-e134c1b119be-image-registry-private-configuration\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424336    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-registry-tls\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424368    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5524210f-2353-4e38-8d9e-e134c1b119be-ca-trust-extracted\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424383    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5524210f-2353-4e38-8d9e-e134c1b119be-registry-certificates\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424399    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5524210f-2353-4e38-8d9e-e134c1b119be-installation-pull-secrets\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424416    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-bound-sa-token\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.424627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.424479    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5524210f-2353-4e38-8d9e-e134c1b119be-trusted-ca\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.474031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.474009    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:31:54.504228 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.504203    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"
Sep 16 13:31:54.524886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.524859    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5524210f-2353-4e38-8d9e-e134c1b119be-image-registry-private-configuration\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.524906    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-registry-tls\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.524940    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5524210f-2353-4e38-8d9e-e134c1b119be-ca-trust-extracted\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.524966    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5524210f-2353-4e38-8d9e-e134c1b119be-registry-certificates\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.524995    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5524210f-2353-4e38-8d9e-e134c1b119be-installation-pull-secrets\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.525023    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-bound-sa-token\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.525131    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5524210f-2353-4e38-8d9e-e134c1b119be-trusted-ca\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.525198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.525179    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2p9\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-kube-api-access-cj2p9\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.526096 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.525853    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5524210f-2353-4e38-8d9e-e134c1b119be-ca-trust-extracted\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.526501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.526453    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5524210f-2353-4e38-8d9e-e134c1b119be-registry-certificates\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.526631 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.526532    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5524210f-2353-4e38-8d9e-e134c1b119be-trusted-ca\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.527965 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.527924    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-registry-tls\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.528399 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.528376    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5524210f-2353-4e38-8d9e-e134c1b119be-installation-pull-secrets\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.529286 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.529262    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5524210f-2353-4e38-8d9e-e134c1b119be-image-registry-private-configuration\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.535715 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.535669    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-bound-sa-token\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.536072 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.536049    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2p9\" (UniqueName: \"kubernetes.io/projected/5524210f-2353-4e38-8d9e-e134c1b119be-kube-api-access-cj2p9\") pod \"image-registry-55569c5dd9-n75sc\" (UID: \"5524210f-2353-4e38-8d9e-e134c1b119be\") " pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.657096 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.657071    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:54.749274 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.749248    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"]
Sep 16 13:31:54.752179 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:54.752155    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299c8fea_10fb_4946_a439_778f47d15ab1.slice/crio-6078e12e64a4957935fa01d97ac51693bb95e9bbcda9883c3de970d1bdd37e66 WatchSource:0}: Error finding container 6078e12e64a4957935fa01d97ac51693bb95e9bbcda9883c3de970d1bdd37e66: Status 404 returned error can't find the container with id 6078e12e64a4957935fa01d97ac51693bb95e9bbcda9883c3de970d1bdd37e66
Sep 16 13:31:54.784243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.784223    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq"]
Sep 16 13:31:54.786810 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:54.786790    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bf7dafb_c189_4a66_9a71_2c4ac40c6c30.slice/crio-efa2755324d5cd7cd6b87f7ed6fa3378266c5852d743cc552a89c0617b6442ea WatchSource:0}: Error finding container efa2755324d5cd7cd6b87f7ed6fa3378266c5852d743cc552a89c0617b6442ea: Status 404 returned error can't find the container with id efa2755324d5cd7cd6b87f7ed6fa3378266c5852d743cc552a89c0617b6442ea
Sep 16 13:31:54.858517 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.858494    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c9d4fd5b-dxkbx"]
Sep 16 13:31:54.860892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.860877    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.864028 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864013    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 13:31:54.864438 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864417    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 13:31:54.864567 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864459    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 13:31:54.864567 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864477    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 13:31:54.864567 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864505    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 13:31:54.864567 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864477    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j4xqz\""
Sep 16 13:31:54.864759 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864583    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 13:31:54.864841 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.864828    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 13:31:54.873408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.873389    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9d4fd5b-dxkbx"]
Sep 16 13:31:54.927609 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.927586    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmf2r\" (UniqueName: \"kubernetes.io/projected/80f2a765-5cbd-44cb-97b6-80f16c3a950b-kube-api-access-dmf2r\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.927691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.927613    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-config\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.927691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.927637    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-serving-cert\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.927691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.927659    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-oauth-config\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.927790 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.927747    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-service-ca\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.927823 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.927795    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-oauth-serving-cert\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:54.929515 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:54.929469    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55569c5dd9-n75sc"]
Sep 16 13:31:54.932530 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:54.932501    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5524210f_2353_4e38_8d9e_e134c1b119be.slice/crio-0b6cd0bf4d68afcfb5cadc141d3469b91758ed2d492bd861096bf6141cc8a200 WatchSource:0}: Error finding container 0b6cd0bf4d68afcfb5cadc141d3469b91758ed2d492bd861096bf6141cc8a200: Status 404 returned error can't find the container with id 0b6cd0bf4d68afcfb5cadc141d3469b91758ed2d492bd861096bf6141cc8a200
Sep 16 13:31:55.028329 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.028295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmf2r\" (UniqueName: \"kubernetes.io/projected/80f2a765-5cbd-44cb-97b6-80f16c3a950b-kube-api-access-dmf2r\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.028444 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.028347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-config\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.028444 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.028383    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-serving-cert\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.028582 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.028530    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-oauth-config\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.028644 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.028603    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-service-ca\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.028698 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.028653    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-oauth-serving-cert\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.029284 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.029261    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-service-ca\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.029396 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.029322    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-config\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.029396 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.029353    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-oauth-serving-cert\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.030693 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.030674    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-serving-cert\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.030783 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.030723    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-oauth-config\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.037295 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.037279    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmf2r\" (UniqueName: \"kubernetes.io/projected/80f2a765-5cbd-44cb-97b6-80f16c3a950b-kube-api-access-dmf2r\") pod \"console-54c9d4fd5b-dxkbx\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") " pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.170595 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.170565    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:31:55.245655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.245632    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4f4bs"
Sep 16 13:31:55.273116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.273083    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq" event={"ID":"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30","Type":"ContainerStarted","Data":"efa2755324d5cd7cd6b87f7ed6fa3378266c5852d743cc552a89c0617b6442ea"}
Sep 16 13:31:55.274337 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.274311    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn" event={"ID":"299c8fea-10fb-4946-a439-778f47d15ab1","Type":"ContainerStarted","Data":"6078e12e64a4957935fa01d97ac51693bb95e9bbcda9883c3de970d1bdd37e66"}
Sep 16 13:31:55.275782 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.275754    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc" event={"ID":"5524210f-2353-4e38-8d9e-e134c1b119be","Type":"ContainerStarted","Data":"04086f6e87b92df6477de2994db67e0d685af9537585506e9ce1015c0f957ebf"}
Sep 16 13:31:55.275866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.275792    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc" event={"ID":"5524210f-2353-4e38-8d9e-e134c1b119be","Type":"ContainerStarted","Data":"0b6cd0bf4d68afcfb5cadc141d3469b91758ed2d492bd861096bf6141cc8a200"}
Sep 16 13:31:55.275916 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.275886    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:31:55.302974 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.302926    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc" podStartSLOduration=1.302910624 podStartE2EDuration="1.302910624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:55.302620857 +0000 UTC m=+60.056310995" watchObservedRunningTime="2026-09-16 13:31:55.302910624 +0000 UTC m=+60.056600738"
Sep 16 13:31:55.448434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.448406    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9d4fd5b-dxkbx"]
Sep 16 13:31:55.455372 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:55.455339    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f2a765_5cbd_44cb_97b6_80f16c3a950b.slice/crio-53db9741e355f3ee43badbb9d7141e379f425a9ac557e7b013ad2b47514a7c0d WatchSource:0}: Error finding container 53db9741e355f3ee43badbb9d7141e379f425a9ac557e7b013ad2b47514a7c0d: Status 404 returned error can't find the container with id 53db9741e355f3ee43badbb9d7141e379f425a9ac557e7b013ad2b47514a7c0d
Sep 16 13:31:55.755815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:55.755780    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz9sf"
Sep 16 13:31:56.281611 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.281580    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9d4fd5b-dxkbx" event={"ID":"80f2a765-5cbd-44cb-97b6-80f16c3a950b","Type":"ContainerStarted","Data":"53db9741e355f3ee43badbb9d7141e379f425a9ac557e7b013ad2b47514a7c0d"}
Sep 16 13:31:56.335495 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.335465    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"]
Sep 16 13:31:56.339171 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.339144    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:31:56.342020 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.341971    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 16 13:31:56.342136 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.342108    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9bxzb\""
Sep 16 13:31:56.403531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.403503    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"]
Sep 16 13:31:56.439838 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.439798    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/050ac75b-db86-4cae-bef9-e5bb4bf2adba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n6zqb\" (UID: \"050ac75b-db86-4cae-bef9-e5bb4bf2adba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:31:56.541003 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.540933    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/050ac75b-db86-4cae-bef9-e5bb4bf2adba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n6zqb\" (UID: \"050ac75b-db86-4cae-bef9-e5bb4bf2adba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:31:56.541152 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:56.541085    2552 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 13:31:56.541152 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:31:56.541149    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050ac75b-db86-4cae-bef9-e5bb4bf2adba-tls-certificates podName:050ac75b-db86-4cae-bef9-e5bb4bf2adba nodeName:}" failed. No retries permitted until 2026-09-16 13:31:57.041131368 +0000 UTC m=+61.794821484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/050ac75b-db86-4cae-bef9-e5bb4bf2adba-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-n6zqb" (UID: "050ac75b-db86-4cae-bef9-e5bb4bf2adba") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 13:31:56.829775 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.829697    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6db76dcd6f-bzsvz"]
Sep 16 13:31:56.838496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.838467    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.845186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.845150    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db76dcd6f-bzsvz"]
Sep 16 13:31:56.849260 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.849120    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 13:31:56.943369 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943341    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-oauth-config\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.943516 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943387    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-service-ca\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.943516 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943430    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-serving-cert\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.943652 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943539    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-console-config\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.943652 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943595    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-trusted-ca-bundle\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.943728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943666    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75ttb\" (UniqueName: \"kubernetes.io/projected/4205355f-6cc5-4443-a076-83f792ec135e-kube-api-access-75ttb\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:56.943728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:56.943687    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-oauth-serving-cert\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.044740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.044709    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/050ac75b-db86-4cae-bef9-e5bb4bf2adba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n6zqb\" (UID: \"050ac75b-db86-4cae-bef9-e5bb4bf2adba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:31:57.044929 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.044747    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-console-config\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.044929 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.044773    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-trusted-ca-bundle\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.044929 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.044891    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75ttb\" (UniqueName: \"kubernetes.io/projected/4205355f-6cc5-4443-a076-83f792ec135e-kube-api-access-75ttb\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.045086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.044930    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-oauth-serving-cert\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.045086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.044971    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-oauth-config\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.045086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.045009    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-service-ca\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.045086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.045050    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-serving-cert\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.045832 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.045516    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-console-config\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.045832 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.045757    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-trusted-ca-bundle\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.046018 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.045960    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-oauth-serving-cert\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.046121 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.046093    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-service-ca\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.047721 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.047690    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/050ac75b-db86-4cae-bef9-e5bb4bf2adba-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-n6zqb\" (UID: \"050ac75b-db86-4cae-bef9-e5bb4bf2adba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:31:57.047834 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.047780    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-serving-cert\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.047944 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.047923    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-oauth-config\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.054594 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.054571    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75ttb\" (UniqueName: \"kubernetes.io/projected/4205355f-6cc5-4443-a076-83f792ec135e-kube-api-access-75ttb\") pod \"console-6db76dcd6f-bzsvz\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") " pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.150446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.150371    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:31:57.249886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.249855    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:31:57.558133 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.557760    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db76dcd6f-bzsvz"]
Sep 16 13:31:57.559909 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:57.559884    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"]
Sep 16 13:31:57.562912 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:57.562861    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4205355f_6cc5_4443_a076_83f792ec135e.slice/crio-857c6a534cfe2148da3ae526edbfa881a2a963bada1fbc165acebf7ccf2c45b3 WatchSource:0}: Error finding container 857c6a534cfe2148da3ae526edbfa881a2a963bada1fbc165acebf7ccf2c45b3: Status 404 returned error can't find the container with id 857c6a534cfe2148da3ae526edbfa881a2a963bada1fbc165acebf7ccf2c45b3
Sep 16 13:31:57.565191 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:31:57.565170    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050ac75b_db86_4cae_bef9_e5bb4bf2adba.slice/crio-65b7429c82aa9938e2ceb9f12ccaae515e9f20dcaef639edf93e7070599d5da3 WatchSource:0}: Error finding container 65b7429c82aa9938e2ceb9f12ccaae515e9f20dcaef639edf93e7070599d5da3: Status 404 returned error can't find the container with id 65b7429c82aa9938e2ceb9f12ccaae515e9f20dcaef639edf93e7070599d5da3
Sep 16 13:31:58.294232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:58.294140    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb" event={"ID":"050ac75b-db86-4cae-bef9-e5bb4bf2adba","Type":"ContainerStarted","Data":"65b7429c82aa9938e2ceb9f12ccaae515e9f20dcaef639edf93e7070599d5da3"}
Sep 16 13:31:58.295981 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:58.295904    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db76dcd6f-bzsvz" event={"ID":"4205355f-6cc5-4443-a076-83f792ec135e","Type":"ContainerStarted","Data":"857c6a534cfe2148da3ae526edbfa881a2a963bada1fbc165acebf7ccf2c45b3"}
Sep 16 13:31:58.299019 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:58.298948    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq" event={"ID":"4bf7dafb-c189-4a66-9a71-2c4ac40c6c30","Type":"ContainerStarted","Data":"1d959cfe8f956f5681232dadb9c282a194bda0fd38675b5ba780907d0b183fec"}
Sep 16 13:31:58.324911 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:31:58.324858    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-567f6ccbb8-srngq" podStartSLOduration=1.796810187 podStartE2EDuration="4.324838908s" totalImagesPullingTime="2.528028721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:31:58.323638504 +0000 UTC m=+63.077328638" watchObservedRunningTime="2026-09-16 13:31:58.324838908 +0000 UTC m=+63.078529032"
Sep 16 13:32:00.478492 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.478456    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:32:00.478982 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.478528    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:32:00.481714 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.481686    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 13:32:00.481844 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.481719    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 13:32:00.491976 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.491952    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f057a5b-7478-4edf-95db-99245dd6bf3e-metrics-certs\") pod \"network-metrics-daemon-bm6k9\" (UID: \"8f057a5b-7478-4edf-95db-99245dd6bf3e\") " pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:32:00.492088 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.491985    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8895c9fb-6858-4e65-8026-7bfe790ae660-original-pull-secret\") pod \"global-pull-secret-syncer-kzns5\" (UID: \"8895c9fb-6858-4e65-8026-7bfe790ae660\") " pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:32:00.579819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.579789    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:32:00.583275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.583254    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 13:32:00.593889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.593867    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 13:32:00.604226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.604206    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzn55\" (UniqueName: \"kubernetes.io/projected/3c787123-1043-4e56-9034-cfe432a748cf-kube-api-access-mzn55\") pod \"network-check-target-kgjgf\" (UID: \"3c787123-1043-4e56-9034-cfe432a748cf\") " pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:32:00.646892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.646874    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4nxp8\""
Sep 16 13:32:00.654420 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.654396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:32:00.655054 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.655036    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4n8lp\""
Sep 16 13:32:00.659703 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.659683    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kzns5"
Sep 16 13:32:00.662716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:00.662700    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bm6k9"
Sep 16 13:32:02.130430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.130280    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kzns5"]
Sep 16 13:32:02.133110 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:32:02.133083    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8895c9fb_6858_4e65_8026_7bfe790ae660.slice/crio-cddeefd6b0fc7888d6ba579d60aca1d61769e7b57d1b92bdab9be4e822781091 WatchSource:0}: Error finding container cddeefd6b0fc7888d6ba579d60aca1d61769e7b57d1b92bdab9be4e822781091: Status 404 returned error can't find the container with id cddeefd6b0fc7888d6ba579d60aca1d61769e7b57d1b92bdab9be4e822781091
Sep 16 13:32:02.137268 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.137244    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgjgf"]
Sep 16 13:32:02.138324 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.138294    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bm6k9"]
Sep 16 13:32:02.139801 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:32:02.139779    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c787123_1043_4e56_9034_cfe432a748cf.slice/crio-c4875a5cbfc50c4df02f40ae56e462935b20eb7fda9ba02edf91e306894cc05b WatchSource:0}: Error finding container c4875a5cbfc50c4df02f40ae56e462935b20eb7fda9ba02edf91e306894cc05b: Status 404 returned error can't find the container with id c4875a5cbfc50c4df02f40ae56e462935b20eb7fda9ba02edf91e306894cc05b
Sep 16 13:32:02.140771 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:32:02.140735    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f057a5b_7478_4edf_95db_99245dd6bf3e.slice/crio-f2421e97c7b883a4d43875de1e7f7bdf32f6bb70fbf5384a81413de02b929632 WatchSource:0}: Error finding container f2421e97c7b883a4d43875de1e7f7bdf32f6bb70fbf5384a81413de02b929632: Status 404 returned error can't find the container with id f2421e97c7b883a4d43875de1e7f7bdf32f6bb70fbf5384a81413de02b929632
Sep 16 13:32:02.322394 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.322354    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn" event={"ID":"299c8fea-10fb-4946-a439-778f47d15ab1","Type":"ContainerStarted","Data":"3c9e2a5e539cf06c2c808bc31f4b9e1cf473392cce7ae91300df3bee2a40a3b7"}
Sep 16 13:32:02.322605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.322589    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:32:02.324329 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.324304    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb" event={"ID":"050ac75b-db86-4cae-bef9-e5bb4bf2adba","Type":"ContainerStarted","Data":"7ec8f9d94a1bec3a094a62c6fcb7ebe2b2cc686671f0a41b5e31361e4f9721d6"}
Sep 16 13:32:02.324457 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.324447    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:32:02.324563 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.324510    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn"
Sep 16 13:32:02.325831 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.325806    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgjgf" event={"ID":"3c787123-1043-4e56-9034-cfe432a748cf","Type":"ContainerStarted","Data":"c4875a5cbfc50c4df02f40ae56e462935b20eb7fda9ba02edf91e306894cc05b"}
Sep 16 13:32:02.327595 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.327575    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9d4fd5b-dxkbx" event={"ID":"80f2a765-5cbd-44cb-97b6-80f16c3a950b","Type":"ContainerStarted","Data":"cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d"}
Sep 16 13:32:02.329365 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.329337    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db76dcd6f-bzsvz" event={"ID":"4205355f-6cc5-4443-a076-83f792ec135e","Type":"ContainerStarted","Data":"fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562"}
Sep 16 13:32:02.330052 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.330035    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb"
Sep 16 13:32:02.330746 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.330728    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kzns5" event={"ID":"8895c9fb-6858-4e65-8026-7bfe790ae660","Type":"ContainerStarted","Data":"cddeefd6b0fc7888d6ba579d60aca1d61769e7b57d1b92bdab9be4e822781091"}
Sep 16 13:32:02.331898 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.331876    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bm6k9" event={"ID":"8f057a5b-7478-4edf-95db-99245dd6bf3e","Type":"ContainerStarted","Data":"f2421e97c7b883a4d43875de1e7f7bdf32f6bb70fbf5384a81413de02b929632"}
Sep 16 13:32:02.340339 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.340299    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64466f4fd4-jmqjn" podStartSLOduration=1.238393052 podStartE2EDuration="8.340285823s" totalImagesPullingTime="7.101892771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:02.339172782 +0000 UTC m=+67.092862903" watchObservedRunningTime="2026-09-16 13:32:02.340285823 +0000 UTC m=+67.093975943"
Sep 16 13:32:02.358149 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.358103    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c9d4fd5b-dxkbx" podStartSLOduration=1.952904664 podStartE2EDuration="8.35808796s" totalImagesPullingTime="6.405183296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:02.357745029 +0000 UTC m=+67.111435163" watchObservedRunningTime="2026-09-16 13:32:02.35808796 +0000 UTC m=+67.111778082"
Sep 16 13:32:02.379899 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.379864    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6db76dcd6f-bzsvz" podStartSLOduration=2.0972426889999998 podStartE2EDuration="6.37985441s" totalImagesPullingTime="4.282611721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:02.379167594 +0000 UTC m=+67.132857714" watchObservedRunningTime="2026-09-16 13:32:02.37985441 +0000 UTC m=+67.133544530"
Sep 16 13:32:02.418770 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:02.418705    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-n6zqb" podStartSLOduration=2.141572044 podStartE2EDuration="6.418692983s" totalImagesPullingTime="4.277120939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:02.41785713 +0000 UTC m=+67.171547252" watchObservedRunningTime="2026-09-16 13:32:02.418692983 +0000 UTC m=+67.172383103"
Sep 16 13:32:04.343236 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:04.343123    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bm6k9" event={"ID":"8f057a5b-7478-4edf-95db-99245dd6bf3e","Type":"ContainerStarted","Data":"8b9234d776fe7ba94b43ca138e8d2d38daf3f76c97a7123764fb237dac4a869a"}
Sep 16 13:32:04.343236 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:04.343195    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bm6k9" event={"ID":"8f057a5b-7478-4edf-95db-99245dd6bf3e","Type":"ContainerStarted","Data":"aef2a2607dd4906e0cd63f31ef3430a22cf9e8d79a9d58ebc9bd8b125e72e0b0"}
Sep 16 13:32:04.368214 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:04.368163    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bm6k9" podStartSLOduration=66.562410283 podStartE2EDuration="1m8.368147702s" totalImagesPullingTime="1.805737419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:04.368002436 +0000 UTC m=+69.121692558" watchObservedRunningTime="2026-09-16 13:32:04.368147702 +0000 UTC m=+69.121837823"
Sep 16 13:32:05.170978 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:05.170943    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:32:05.171245 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:05.171014    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:32:05.176389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:05.176322    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:32:05.352987 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:05.352960    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:32:06.355761 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:06.355681    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgjgf" event={"ID":"3c787123-1043-4e56-9034-cfe432a748cf","Type":"ContainerStarted","Data":"eff4fc99f89763b48cde69bf4f22c28b38c7262ff1dabc49412eb9e6fa3cfb53"}
Sep 16 13:32:06.356204 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:06.356119    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:32:06.372424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:06.372381    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kgjgf" podStartSLOduration=66.417781965 podStartE2EDuration="1m10.372363715s" totalImagesPullingTime="3.95458175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:06.371425498 +0000 UTC m=+71.125115618" watchObservedRunningTime="2026-09-16 13:32:06.372363715 +0000 UTC m=+71.126053836"
Sep 16 13:32:07.151463 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:07.151428    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:32:07.151825 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:07.151799    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:32:07.156699 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:07.156678    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:32:07.364001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:07.363963    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:32:07.420995 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:07.420924    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c9d4fd5b-dxkbx"]
Sep 16 13:32:08.364720 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:08.364681    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kzns5" event={"ID":"8895c9fb-6858-4e65-8026-7bfe790ae660","Type":"ContainerStarted","Data":"e80e6cb0392cc1abb1499ea2d04f618c65652ddf8d30faf432da3c12c1487fda"}
Sep 16 13:32:08.383155 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:08.383115    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kzns5" podStartSLOduration=66.900387516 podStartE2EDuration="1m12.383101925s" totalImagesPullingTime="5.482714409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:08.38258288 +0000 UTC m=+73.136273000" watchObservedRunningTime="2026-09-16 13:32:08.383101925 +0000 UTC m=+73.136792047"
Sep 16 13:32:14.805742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.805709    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"]
Sep 16 13:32:14.809277 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.809258    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.812426 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.812400    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 16 13:32:14.812712 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.812684    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 16 13:32:14.812834 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.812773    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 13:32:14.813243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.813225    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 13:32:14.813876 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.813857    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rq6t7\""
Sep 16 13:32:14.818379 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.818360    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 13:32:14.829927 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.829905    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"]
Sep 16 13:32:14.836151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.836123    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9qmhh"]
Sep 16 13:32:14.838345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.838325    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.841516 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.841315    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 13:32:14.841516 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.841356    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 13:32:14.841686 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.841653    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 13:32:14.841761 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.841714    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-txljv\""
Sep 16 13:32:14.881241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881198    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881690 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881663    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.881786 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881716    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-sys\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881786 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881746    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b7158e9-9650-478b-a389-3fba66b81ca5-metrics-client-ca\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881786 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881778    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-textfile\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881808    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjt9s\" (UniqueName: \"kubernetes.io/projected/7b7158e9-9650-478b-a389-3fba66b81ca5-kube-api-access-sjt9s\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881868    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.881937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881892    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-tls\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.881937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881932    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8m9f\" (UniqueName: \"kubernetes.io/projected/afbed6fe-85d8-4df4-a8a3-974946a6e161-kube-api-access-j8m9f\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.882166 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.881961    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-root\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.882166 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.882030    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbed6fe-85d8-4df4-a8a3-974946a6e161-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.882166 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.882072    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-wtmp\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.982988    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983155 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983031    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.983155 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:32:14.983137    2552 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 16 13:32:14.983266 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983157    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-tls\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983266 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:32:14.983208    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-tls podName:afbed6fe-85d8-4df4-a8a3-974946a6e161 nodeName:}" failed. No retries permitted until 2026-09-16 13:32:15.483187694 +0000 UTC m=+80.236877796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-rslvf" (UID: "afbed6fe-85d8-4df4-a8a3-974946a6e161") : secret "openshift-state-metrics-tls" not found
Sep 16 13:32:14.983266 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983244    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8m9f\" (UniqueName: \"kubernetes.io/projected/afbed6fe-85d8-4df4-a8a3-974946a6e161-kube-api-access-j8m9f\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.983423 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983271    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-root\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983423 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:32:14.983275    2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 16 13:32:14.983423 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983308    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbed6fe-85d8-4df4-a8a3-974946a6e161-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.983423 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:32:14.983343    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-tls podName:7b7158e9-9650-478b-a389-3fba66b81ca5 nodeName:}" failed. No retries permitted until 2026-09-16 13:32:15.48332478 +0000 UTC m=+80.237014894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-tls") pod "node-exporter-9qmhh" (UID: "7b7158e9-9650-478b-a389-3fba66b81ca5") : secret "node-exporter-tls" not found
Sep 16 13:32:14.983423 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983378    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-wtmp\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983423 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983412    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983446    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983485    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-sys\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983512    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b7158e9-9650-478b-a389-3fba66b81ca5-metrics-client-ca\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983540    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-textfile\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983591    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjt9s\" (UniqueName: \"kubernetes.io/projected/7b7158e9-9650-478b-a389-3fba66b81ca5-kube-api-access-sjt9s\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983614    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-wtmp\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.983745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983678    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-sys\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.984075 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.983981    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afbed6fe-85d8-4df4-a8a3-974946a6e161-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:14.984254 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.984231    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b7158e9-9650-478b-a389-3fba66b81ca5-root\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.984333 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.984232    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.984589 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.984564    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-textfile\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.984695 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.984686    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b7158e9-9650-478b-a389-3fba66b81ca5-metrics-client-ca\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.985796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.985766    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:14.986561 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:14.986521    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:15.000987 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.000959    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8m9f\" (UniqueName: \"kubernetes.io/projected/afbed6fe-85d8-4df4-a8a3-974946a6e161-kube-api-access-j8m9f\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:15.001327 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.001308    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjt9s\" (UniqueName: \"kubernetes.io/projected/7b7158e9-9650-478b-a389-3fba66b81ca5-kube-api-access-sjt9s\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:15.486729 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.486699    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:15.486877 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.486752    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-tls\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:15.489022 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.488995    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afbed6fe-85d8-4df4-a8a3-974946a6e161-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rslvf\" (UID: \"afbed6fe-85d8-4df4-a8a3-974946a6e161\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:15.489396 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.489375    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b7158e9-9650-478b-a389-3fba66b81ca5-node-exporter-tls\") pod \"node-exporter-9qmhh\" (UID: \"7b7158e9-9650-478b-a389-3fba66b81ca5\") " pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:15.720648 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.720617    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"
Sep 16 13:32:15.749483 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:15.749413    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qmhh"
Sep 16 13:32:15.761075 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:32:15.761043    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7158e9_9650_478b_a389_3fba66b81ca5.slice/crio-80f8a3d1076101fe08bd56010636cdfee356603d739ee7fe48a4bdacce5ceaf2 WatchSource:0}: Error finding container 80f8a3d1076101fe08bd56010636cdfee356603d739ee7fe48a4bdacce5ceaf2: Status 404 returned error can't find the container with id 80f8a3d1076101fe08bd56010636cdfee356603d739ee7fe48a4bdacce5ceaf2
Sep 16 13:32:16.014113 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:32:16.014087    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbed6fe_85d8_4df4_a8a3_974946a6e161.slice/crio-eba35489199055a22a18655ba57e4f37ba5472b3ad347aa66fe9910805b8c615 WatchSource:0}: Error finding container eba35489199055a22a18655ba57e4f37ba5472b3ad347aa66fe9910805b8c615: Status 404 returned error can't find the container with id eba35489199055a22a18655ba57e4f37ba5472b3ad347aa66fe9910805b8c615
Sep 16 13:32:16.016272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:16.016245    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf"]
Sep 16 13:32:16.286236 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:16.286171    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55569c5dd9-n75sc"
Sep 16 13:32:16.394100 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:16.394068    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf" event={"ID":"afbed6fe-85d8-4df4-a8a3-974946a6e161","Type":"ContainerStarted","Data":"094578f48987d50c1c522f674213b3a455579b22503aff10af3fa37eb6a28f29"}
Sep 16 13:32:16.394279 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:16.394134    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf" event={"ID":"afbed6fe-85d8-4df4-a8a3-974946a6e161","Type":"ContainerStarted","Data":"59b953ad3054a60dc9eebfe5aa7df2ba1da28e33ecf3fb82b597bf7dc1fbd71e"}
Sep 16 13:32:16.394279 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:16.394173    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf" event={"ID":"afbed6fe-85d8-4df4-a8a3-974946a6e161","Type":"ContainerStarted","Data":"eba35489199055a22a18655ba57e4f37ba5472b3ad347aa66fe9910805b8c615"}
Sep 16 13:32:16.395583 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:16.395528    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qmhh" event={"ID":"7b7158e9-9650-478b-a389-3fba66b81ca5","Type":"ContainerStarted","Data":"80f8a3d1076101fe08bd56010636cdfee356603d739ee7fe48a4bdacce5ceaf2"}
Sep 16 13:32:17.400940 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:17.400862    2552 generic.go:356] "Generic (PLEG): container finished" podID="7b7158e9-9650-478b-a389-3fba66b81ca5" containerID="6cd14aba7f4188710e42c7a0f7ec8b216c6ed765c5195b4ced62d6854bbb1ec7" exitCode=0
Sep 16 13:32:17.401281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:17.400953    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qmhh" event={"ID":"7b7158e9-9650-478b-a389-3fba66b81ca5","Type":"ContainerDied","Data":"6cd14aba7f4188710e42c7a0f7ec8b216c6ed765c5195b4ced62d6854bbb1ec7"}
Sep 16 13:32:17.403229 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:17.403203    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf" event={"ID":"afbed6fe-85d8-4df4-a8a3-974946a6e161","Type":"ContainerStarted","Data":"bf3019b1e4e210ce69f4ef98290d5cf2a865bc48a9234761c18b812e42a17bb7"}
Sep 16 13:32:17.447007 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:17.446967    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rslvf" podStartSLOduration=2.437545997 podStartE2EDuration="3.446949976s" totalImagesPullingTime="1.009403979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:17.446521387 +0000 UTC m=+82.200211509" watchObservedRunningTime="2026-09-16 13:32:17.446949976 +0000 UTC m=+82.200640098"
Sep 16 13:32:18.408907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:18.408797    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qmhh" event={"ID":"7b7158e9-9650-478b-a389-3fba66b81ca5","Type":"ContainerStarted","Data":"7c848c77c8fdc28c5ae38f29a6ae40b4594127a321e9020a5d86cb38d928b5c3"}
Sep 16 13:32:18.408907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:18.408857    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qmhh" event={"ID":"7b7158e9-9650-478b-a389-3fba66b81ca5","Type":"ContainerStarted","Data":"0b7baebf4b2c5438dc697a50129837257555ac28e2caaff51c5e40a865f98908"}
Sep 16 13:32:18.434331 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:18.434285    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9qmhh" podStartSLOduration=3.285753205 podStartE2EDuration="4.434270191s" totalImagesPullingTime="1.079862679s" totalInitContainerRuntime="68.654307ms" isStatefulPod=true podCreationTimestamp="2026-09-16 13:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:18.432304801 +0000 UTC m=+83.185994918" watchObservedRunningTime="2026-09-16 13:32:18.434270191 +0000 UTC m=+83.187960312"
Sep 16 13:32:21.265431 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.265401    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 13:32:21.268663 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.268638    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.290900 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.290875    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 13:32:21.291031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.290911    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 13:32:21.291031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.290922    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 13:32:21.291031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.290959    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 13:32:21.291031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.290971    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 13:32:21.291031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.290922    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 13:32:21.291228 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.291209    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 13:32:21.291270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.291232    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 13:32:21.291270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.291259    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 13:32:21.291335 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.291239    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 13:32:21.292389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.292366    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 13:32:21.292389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.292392    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 13:32:21.292572 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.292370    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 13:32:21.292572 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.292500    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5qs17kjjh8q01\""
Sep 16 13:32:21.292816 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.292801    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gqt26\""
Sep 16 13:32:21.294388 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.294374    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 13:32:21.301134 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.301116    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 13:32:21.322310 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.322287    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 13:32:21.327014 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.326994    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327112 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327023    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327112 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327041    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327112 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327067    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327112 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327109    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-config\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327263 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327130    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327263 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327161    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gps\" (UniqueName: \"kubernetes.io/projected/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-kube-api-access-84gps\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327263 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327205    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327263 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327243    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327263 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327258    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-config-out\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327274    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327305    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327325    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327341    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327361    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327696 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327470    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-web-config\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327696 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327494    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327696 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327523    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.327696 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.327593    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428222 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428191    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428222 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428222    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428239    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-web-config\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428264    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428328    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428373    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428423    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.428702 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428647    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.429044 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.429044 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.428991    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.429228 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429072    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429332    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-config\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429375    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429414    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gps\" (UniqueName: \"kubernetes.io/projected/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-kube-api-access-84gps\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429453    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429483    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429510    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-config-out\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429537    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429590    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429620    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429652    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.429964    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.430679 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.430257    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.431345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.430917    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.431345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.431318    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.431715    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-web-config\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.431877    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.431932    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432338 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.432227    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432338 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.432266    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432973 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.432600    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432973 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.432792    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.432973 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.432933    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.433253 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.433229    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.433710 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.433687    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-config\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.434306 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.434260    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.434407 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.434366    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.434481 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.434435    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-config-out\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.435041 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.435024    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.441761 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.441738    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gps\" (UniqueName: \"kubernetes.io/projected/f9196236-83a8-4b5f-a4cd-9fea80b5d34b-kube-api-access-84gps\") pod \"prometheus-k8s-0\" (UID: \"f9196236-83a8-4b5f-a4cd-9fea80b5d34b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.578101 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.578038    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:21.877506 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:21.877427    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 13:32:21.881335 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:32:21.881311    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9196236_83a8_4b5f_a4cd_9fea80b5d34b.slice/crio-9b33bcfeded00adfde447ea90156b63e6e2ac9bcec733f5d1247f0c68f381f1d WatchSource:0}: Error finding container 9b33bcfeded00adfde447ea90156b63e6e2ac9bcec733f5d1247f0c68f381f1d: Status 404 returned error can't find the container with id 9b33bcfeded00adfde447ea90156b63e6e2ac9bcec733f5d1247f0c68f381f1d
Sep 16 13:32:22.426879 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:22.426844    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"9b33bcfeded00adfde447ea90156b63e6e2ac9bcec733f5d1247f0c68f381f1d"}
Sep 16 13:32:23.432062 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:23.432024    2552 generic.go:356] "Generic (PLEG): container finished" podID="f9196236-83a8-4b5f-a4cd-9fea80b5d34b" containerID="0ea1e41ebbc783c65175d6876d537fbb9ba1bc0cf899ed26689c236bbce1a907" exitCode=0
Sep 16 13:32:23.432412 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:23.432069    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerDied","Data":"0ea1e41ebbc783c65175d6876d537fbb9ba1bc0cf899ed26689c236bbce1a907"}
Sep 16 13:32:27.451710 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:27.451673    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"67f2488f2c4e543ffcf2c2838358f8951fa00602a39383f874eee008ad827ef8"}
Sep 16 13:32:27.452060 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:27.451771    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"1bd848686653d6d0eaebbf6aeeef9fbd26bdc20ec591acb8ae09f91ea6eba6c4"}
Sep 16 13:32:29.462037 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:29.462009    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"5d4a94774bcbcebdc4b8056d4b2d6267ed6335d72a1e133476f61567bc03fc39"}
Sep 16 13:32:30.473363 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:30.473323    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"ee0280453d5a2acdc02c2e414aa674ccf6eb4c9e19d71b901741563f39cc28da"}
Sep 16 13:32:30.473763 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:30.473406    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"bbf1b6e0e75384fe226691b6a15ee100b46c660f27b2adc5da3a926963985f09"}
Sep 16 13:32:30.473763 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:30.473433    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9196236-83a8-4b5f-a4cd-9fea80b5d34b","Type":"ContainerStarted","Data":"970e1b711cd8e1292624b8bc750348bd16b5f9493b3e3ddeaa5a5deae70cd07f"}
Sep 16 13:32:30.517045 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:30.516987    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8595393810000003 podStartE2EDuration="9.516970958s" totalImagesPullingTime="6.639911197s" totalInitContainerRuntime="17.52038ms" isStatefulPod=false podCreationTimestamp="2026-09-16 13:32:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:32:30.515144703 +0000 UTC m=+95.268834847" watchObservedRunningTime="2026-09-16 13:32:30.516970958 +0000 UTC m=+95.270661078"
Sep 16 13:32:30.940804 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:30.940772    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6db76dcd6f-bzsvz"]
Sep 16 13:32:31.579146 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:31.579119    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:32:32.444908 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.444862    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54c9d4fd5b-dxkbx" podUID="80f2a765-5cbd-44cb-97b6-80f16c3a950b" containerName="console" containerID="cri-o://cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d" gracePeriod=15
Sep 16 13:32:32.733216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.733166    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:32:32.819444 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819422    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-config\") pod \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") "
Sep 16 13:32:32.819577 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819465    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-service-ca\") pod \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") "
Sep 16 13:32:32.819577 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819495    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-serving-cert\") pod \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") "
Sep 16 13:32:32.819577 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819521    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-oauth-serving-cert\") pod \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") "
Sep 16 13:32:32.819735 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819597    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmf2r\" (UniqueName: \"kubernetes.io/projected/80f2a765-5cbd-44cb-97b6-80f16c3a950b-kube-api-access-dmf2r\") pod \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") "
Sep 16 13:32:32.819735 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819617    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-oauth-config\") pod \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\" (UID: \"80f2a765-5cbd-44cb-97b6-80f16c3a950b\") "
Sep 16 13:32:32.819920 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819888    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-service-ca" (OuterVolumeSpecName: "service-ca") pod "80f2a765-5cbd-44cb-97b6-80f16c3a950b" (UID: "80f2a765-5cbd-44cb-97b6-80f16c3a950b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:32.819920 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819884    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-config" (OuterVolumeSpecName: "console-config") pod "80f2a765-5cbd-44cb-97b6-80f16c3a950b" (UID: "80f2a765-5cbd-44cb-97b6-80f16c3a950b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:32.820066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.819937    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80f2a765-5cbd-44cb-97b6-80f16c3a950b" (UID: "80f2a765-5cbd-44cb-97b6-80f16c3a950b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:32.821848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.821822    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80f2a765-5cbd-44cb-97b6-80f16c3a950b" (UID: "80f2a765-5cbd-44cb-97b6-80f16c3a950b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:32:32.821923 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.821853    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f2a765-5cbd-44cb-97b6-80f16c3a950b-kube-api-access-dmf2r" (OuterVolumeSpecName: "kube-api-access-dmf2r") pod "80f2a765-5cbd-44cb-97b6-80f16c3a950b" (UID: "80f2a765-5cbd-44cb-97b6-80f16c3a950b"). InnerVolumeSpecName "kube-api-access-dmf2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:32:32.821923 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.821871    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80f2a765-5cbd-44cb-97b6-80f16c3a950b" (UID: "80f2a765-5cbd-44cb-97b6-80f16c3a950b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:32:32.920644 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.920621    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-oauth-serving-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:32.920644 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.920641    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmf2r\" (UniqueName: \"kubernetes.io/projected/80f2a765-5cbd-44cb-97b6-80f16c3a950b-kube-api-access-dmf2r\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:32.920764 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.920650    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-oauth-config\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:32.920764 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.920658    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-config\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:32.920764 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.920666    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80f2a765-5cbd-44cb-97b6-80f16c3a950b-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:32.920764 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:32.920674    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80f2a765-5cbd-44cb-97b6-80f16c3a950b-console-serving-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:33.487778 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.487744    2552 generic.go:356] "Generic (PLEG): container finished" podID="80f2a765-5cbd-44cb-97b6-80f16c3a950b" containerID="cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d" exitCode=0
Sep 16 13:32:33.487948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.487794    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9d4fd5b-dxkbx" event={"ID":"80f2a765-5cbd-44cb-97b6-80f16c3a950b","Type":"ContainerDied","Data":"cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d"}
Sep 16 13:32:33.487948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.487830    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9d4fd5b-dxkbx" event={"ID":"80f2a765-5cbd-44cb-97b6-80f16c3a950b","Type":"ContainerDied","Data":"53db9741e355f3ee43badbb9d7141e379f425a9ac557e7b013ad2b47514a7c0d"}
Sep 16 13:32:33.487948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.487850    2552 scope.go:117] "RemoveContainer" containerID="cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d"
Sep 16 13:32:33.487948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.487793    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9d4fd5b-dxkbx"
Sep 16 13:32:33.507080 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.507056    2552 scope.go:117] "RemoveContainer" containerID="cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d"
Sep 16 13:32:33.507496 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:32:33.507468    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d\": container with ID starting with cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d not found: ID does not exist" containerID="cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d"
Sep 16 13:32:33.507649 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.507518    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d"} err="failed to get container status \"cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d\": rpc error: code = NotFound desc = could not find container \"cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d\": container with ID starting with cce6ffa83ed9b40d21cb9eb6db7508b41fd4b2136f15655903a2de21338fc75d not found: ID does not exist"
Sep 16 13:32:33.509511 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.509490    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c9d4fd5b-dxkbx"]
Sep 16 13:32:33.513281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.513264    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54c9d4fd5b-dxkbx"]
Sep 16 13:32:33.836056 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:33.836023    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f2a765-5cbd-44cb-97b6-80f16c3a950b" path="/var/lib/kubelet/pods/80f2a765-5cbd-44cb-97b6-80f16c3a950b/volumes"
Sep 16 13:32:38.367765 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:38.367737    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kgjgf"
Sep 16 13:32:55.959833 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:55.959742    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6db76dcd6f-bzsvz" podUID="4205355f-6cc5-4443-a076-83f792ec135e" containerName="console" containerID="cri-o://fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562" gracePeriod=15
Sep 16 13:32:56.195654 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.195630    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:32:56.289963 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.289936    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-oauth-serving-cert\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290087 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.289973    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-service-ca\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290087 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290012    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-serving-cert\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290087 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290080    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-console-config\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290266 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290167    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-trusted-ca-bundle\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290266 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290193    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-oauth-config\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290266 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290223    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75ttb\" (UniqueName: \"kubernetes.io/projected/4205355f-6cc5-4443-a076-83f792ec135e-kube-api-access-75ttb\") pod \"4205355f-6cc5-4443-a076-83f792ec135e\" (UID: \"4205355f-6cc5-4443-a076-83f792ec135e\") "
Sep 16 13:32:56.290409 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290351    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-service-ca" (OuterVolumeSpecName: "service-ca") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:56.290409 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290360    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:56.290503 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290477    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-console-config" (OuterVolumeSpecName: "console-config") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:56.290573 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290490    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.290626 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.290600    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:32:56.292172 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.292145    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:32:56.292294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.292255    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4205355f-6cc5-4443-a076-83f792ec135e-kube-api-access-75ttb" (OuterVolumeSpecName: "kube-api-access-75ttb") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "kube-api-access-75ttb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:32:56.292349 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.292283    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4205355f-6cc5-4443-a076-83f792ec135e" (UID: "4205355f-6cc5-4443-a076-83f792ec135e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:32:56.391194 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.391170    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-oauth-serving-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.391194 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.391193    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-serving-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.391321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.391207    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-console-config\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.391321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.391220    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4205355f-6cc5-4443-a076-83f792ec135e-trusted-ca-bundle\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.391321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.391232    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4205355f-6cc5-4443-a076-83f792ec135e-console-oauth-config\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.391321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.391244    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75ttb\" (UniqueName: \"kubernetes.io/projected/4205355f-6cc5-4443-a076-83f792ec135e-kube-api-access-75ttb\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:32:56.574194 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.574116    2552 generic.go:356] "Generic (PLEG): container finished" podID="4205355f-6cc5-4443-a076-83f792ec135e" containerID="fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562" exitCode=0
Sep 16 13:32:56.574194 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.574166    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db76dcd6f-bzsvz"
Sep 16 13:32:56.574374 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.574158    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db76dcd6f-bzsvz" event={"ID":"4205355f-6cc5-4443-a076-83f792ec135e","Type":"ContainerDied","Data":"fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562"}
Sep 16 13:32:56.574374 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.574292    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db76dcd6f-bzsvz" event={"ID":"4205355f-6cc5-4443-a076-83f792ec135e","Type":"ContainerDied","Data":"857c6a534cfe2148da3ae526edbfa881a2a963bada1fbc165acebf7ccf2c45b3"}
Sep 16 13:32:56.574374 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.574322    2552 scope.go:117] "RemoveContainer" containerID="fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562"
Sep 16 13:32:56.582462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.582303    2552 scope.go:117] "RemoveContainer" containerID="fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562"
Sep 16 13:32:56.582595 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:32:56.582572    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562\": container with ID starting with fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562 not found: ID does not exist" containerID="fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562"
Sep 16 13:32:56.582698 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.582599    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562"} err="failed to get container status \"fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562\": rpc error: code = NotFound desc = could not find container \"fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562\": container with ID starting with fb926a91681edd88d6c4f04702eb14c3f187bfb1914908284c5b0b90c568e562 not found: ID does not exist"
Sep 16 13:32:56.594970 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.594948    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6db76dcd6f-bzsvz"]
Sep 16 13:32:56.597770 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:56.597752    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6db76dcd6f-bzsvz"]
Sep 16 13:32:57.836361 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:32:57.836333    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4205355f-6cc5-4443-a076-83f792ec135e" path="/var/lib/kubelet/pods/4205355f-6cc5-4443-a076-83f792ec135e/volumes"
Sep 16 13:33:21.578807 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:33:21.578761    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:33:21.597255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:33:21.597221    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:33:21.676878 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:33:21.676855    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 13:35:55.589215 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:35:55.589189    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:35:55.590236 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:35:55.590215    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:35:55.602892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:35:55.602872    2552 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 13:36:05.742648 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742617    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"]
Sep 16 13:36:05.744977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742858    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4205355f-6cc5-4443-a076-83f792ec135e" containerName="console"
Sep 16 13:36:05.744977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742869    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4205355f-6cc5-4443-a076-83f792ec135e" containerName="console"
Sep 16 13:36:05.744977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742891    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f2a765-5cbd-44cb-97b6-80f16c3a950b" containerName="console"
Sep 16 13:36:05.744977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742897    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f2a765-5cbd-44cb-97b6-80f16c3a950b" containerName="console"
Sep 16 13:36:05.744977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742938    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4205355f-6cc5-4443-a076-83f792ec135e" containerName="console"
Sep 16 13:36:05.744977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.742949    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f2a765-5cbd-44cb-97b6-80f16c3a950b" containerName="console"
Sep 16 13:36:05.745765 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.745750    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:05.748740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.748719    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 13:36:05.749914 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.749899    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-67s2k\""
Sep 16 13:36:05.750008 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.749908    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 13:36:05.755227 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.755209    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"]
Sep 16 13:36:05.791492 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.791470    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlp7\" (UniqueName: \"kubernetes.io/projected/12d58816-f8b7-4ad1-b0eb-dfbd704e014a-kube-api-access-wqlp7\") pod \"openshift-lws-operator-fd8ccff4c-r9g4k\" (UID: \"12d58816-f8b7-4ad1-b0eb-dfbd704e014a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:05.791603 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.791504    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d58816-f8b7-4ad1-b0eb-dfbd704e014a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r9g4k\" (UID: \"12d58816-f8b7-4ad1-b0eb-dfbd704e014a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:05.892219 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.892200    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlp7\" (UniqueName: \"kubernetes.io/projected/12d58816-f8b7-4ad1-b0eb-dfbd704e014a-kube-api-access-wqlp7\") pod \"openshift-lws-operator-fd8ccff4c-r9g4k\" (UID: \"12d58816-f8b7-4ad1-b0eb-dfbd704e014a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:05.892357 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.892232    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d58816-f8b7-4ad1-b0eb-dfbd704e014a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r9g4k\" (UID: \"12d58816-f8b7-4ad1-b0eb-dfbd704e014a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:05.892565 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.892528    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d58816-f8b7-4ad1-b0eb-dfbd704e014a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-r9g4k\" (UID: \"12d58816-f8b7-4ad1-b0eb-dfbd704e014a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:05.903257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:05.903231    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlp7\" (UniqueName: \"kubernetes.io/projected/12d58816-f8b7-4ad1-b0eb-dfbd704e014a-kube-api-access-wqlp7\") pod \"openshift-lws-operator-fd8ccff4c-r9g4k\" (UID: \"12d58816-f8b7-4ad1-b0eb-dfbd704e014a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:06.054247 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:06.054225    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"
Sep 16 13:36:06.325860 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:06.325838    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k"]
Sep 16 13:36:06.327810 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:36:06.327784    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12d58816_f8b7_4ad1_b0eb_dfbd704e014a.slice/crio-08155184391fb8e9f5287d1f21189ad2e8388936af62f3f54a4e4959fc9f2bd5 WatchSource:0}: Error finding container 08155184391fb8e9f5287d1f21189ad2e8388936af62f3f54a4e4959fc9f2bd5: Status 404 returned error can't find the container with id 08155184391fb8e9f5287d1f21189ad2e8388936af62f3f54a4e4959fc9f2bd5
Sep 16 13:36:06.329189 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:06.329173    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:36:07.239100 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:07.239056    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k" event={"ID":"12d58816-f8b7-4ad1-b0eb-dfbd704e014a","Type":"ContainerStarted","Data":"08155184391fb8e9f5287d1f21189ad2e8388936af62f3f54a4e4959fc9f2bd5"}
Sep 16 13:36:09.248353 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:09.248315    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k" event={"ID":"12d58816-f8b7-4ad1-b0eb-dfbd704e014a","Type":"ContainerStarted","Data":"14899030a97196188fd274c7e9b0949334ba36178a931876f16aecccc1456eb5"}
Sep 16 13:36:09.270489 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:09.270441    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-r9g4k" podStartSLOduration=1.5694135409999999 podStartE2EDuration="4.270427562s" totalImagesPullingTime="2.701014021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:36:09.269332539 +0000 UTC m=+314.023022662" watchObservedRunningTime="2026-09-16 13:36:09.270427562 +0000 UTC m=+314.024117747"
Sep 16 13:36:27.060161 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.060131    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"]
Sep 16 13:36:27.063204 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.063188    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.066988 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.066966    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 13:36:27.067241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.067224    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 13:36:27.067355 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.067335    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2tk7k\""
Sep 16 13:36:27.067789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.067775    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 13:36:27.068756 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.068737    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 13:36:27.107429 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.107405    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"]
Sep 16 13:36:27.146047 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.146012    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76e1afd2-3c5c-4e71-a013-53bf11ae860f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.146142 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.146053    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76e1afd2-3c5c-4e71-a013-53bf11ae860f-manifests\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.146142 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.146095    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e1afd2-3c5c-4e71-a013-53bf11ae860f-tmp\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.146142 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.146133    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkhn\" (UniqueName: \"kubernetes.io/projected/76e1afd2-3c5c-4e71-a013-53bf11ae860f-kube-api-access-8vkhn\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.146254 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.146164    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76e1afd2-3c5c-4e71-a013-53bf11ae860f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.247322 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.247295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkhn\" (UniqueName: \"kubernetes.io/projected/76e1afd2-3c5c-4e71-a013-53bf11ae860f-kube-api-access-8vkhn\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.247430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.247329    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76e1afd2-3c5c-4e71-a013-53bf11ae860f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.247430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.247366    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76e1afd2-3c5c-4e71-a013-53bf11ae860f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.247430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.247384    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76e1afd2-3c5c-4e71-a013-53bf11ae860f-manifests\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.247430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.247412    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e1afd2-3c5c-4e71-a013-53bf11ae860f-tmp\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.247853 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.247827    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76e1afd2-3c5c-4e71-a013-53bf11ae860f-manifests\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.249625 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.249603    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e1afd2-3c5c-4e71-a013-53bf11ae860f-tmp\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.249744 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.249728    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76e1afd2-3c5c-4e71-a013-53bf11ae860f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.249824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.249808    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76e1afd2-3c5c-4e71-a013-53bf11ae860f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.277134 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.277110    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkhn\" (UniqueName: \"kubernetes.io/projected/76e1afd2-3c5c-4e71-a013-53bf11ae860f-kube-api-access-8vkhn\") pod \"opendatahub-operator-controller-manager-5fdfbf9c59-blxwt\" (UID: \"76e1afd2-3c5c-4e71-a013-53bf11ae860f\") " pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.373159 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.373104    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:27.687949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:27.687875    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"]
Sep 16 13:36:27.690984 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:36:27.690957    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e1afd2_3c5c_4e71_a013_53bf11ae860f.slice/crio-e54b15ccb9eaf252c8b27ca146ae2371bf81249f4ce63ec66a00f0937d58ceb9 WatchSource:0}: Error finding container e54b15ccb9eaf252c8b27ca146ae2371bf81249f4ce63ec66a00f0937d58ceb9: Status 404 returned error can't find the container with id e54b15ccb9eaf252c8b27ca146ae2371bf81249f4ce63ec66a00f0937d58ceb9
Sep 16 13:36:28.321309 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:28.321272    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt" event={"ID":"76e1afd2-3c5c-4e71-a013-53bf11ae860f","Type":"ContainerStarted","Data":"e54b15ccb9eaf252c8b27ca146ae2371bf81249f4ce63ec66a00f0937d58ceb9"}
Sep 16 13:36:31.336738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:31.336703    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt" event={"ID":"76e1afd2-3c5c-4e71-a013-53bf11ae860f","Type":"ContainerStarted","Data":"f20fb92a5dc3bafbde21e460dead3053f8e61ff67679bc2976b78864a671887a"}
Sep 16 13:36:32.341884 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:32.341850    2552 generic.go:356] "Generic (PLEG): container finished" podID="76e1afd2-3c5c-4e71-a013-53bf11ae860f" containerID="f20fb92a5dc3bafbde21e460dead3053f8e61ff67679bc2976b78864a671887a" exitCode=0
Sep 16 13:36:32.342256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:32.341930    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt" event={"ID":"76e1afd2-3c5c-4e71-a013-53bf11ae860f","Type":"ContainerDied","Data":"f20fb92a5dc3bafbde21e460dead3053f8e61ff67679bc2976b78864a671887a"}
Sep 16 13:36:33.348141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:33.348108    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt" event={"ID":"76e1afd2-3c5c-4e71-a013-53bf11ae860f","Type":"ContainerStarted","Data":"e8c918e53946c483d97a91a3442c43ae7c44071e5fe9e44cea6a1ea17f8520b7"}
Sep 16 13:36:33.348487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:33.348210    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:33.404292 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:33.404252    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt" podStartSLOduration=2.902158256 podStartE2EDuration="7.404238745s" totalImagesPullingTime="3.422056305s" totalInitContainerRuntime="1.080024184s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:36:33.40383042 +0000 UTC m=+338.157520541" watchObservedRunningTime="2026-09-16 13:36:33.404238745 +0000 UTC m=+338.157928865"
Sep 16 13:36:44.354312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:44.354281    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fdfbf9c59-blxwt"
Sep 16 13:36:47.954678 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.954646    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"]
Sep 16 13:36:47.967946 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.967889    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:47.971244 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.971218    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 13:36:47.971244 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.971232    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"]
Sep 16 13:36:47.972689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.972074    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kx8kk\""
Sep 16 13:36:47.972689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.972299    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 13:36:47.972689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.972495    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 13:36:47.972689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:47.972512    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 13:36:48.096178 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.096146    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7117a2b0-e564-451b-a827-7e4587853047-tls-certs\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.096330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.096186    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpd48\" (UniqueName: \"kubernetes.io/projected/7117a2b0-e564-451b-a827-7e4587853047-kube-api-access-bpd48\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.096330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.096280    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7117a2b0-e564-451b-a827-7e4587853047-tmp\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.196964 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.196933    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7117a2b0-e564-451b-a827-7e4587853047-tmp\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.197084 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.196978    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7117a2b0-e564-451b-a827-7e4587853047-tls-certs\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.197084 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.197000    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpd48\" (UniqueName: \"kubernetes.io/projected/7117a2b0-e564-451b-a827-7e4587853047-kube-api-access-bpd48\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.199150 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.199120    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7117a2b0-e564-451b-a827-7e4587853047-tmp\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.199332 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.199313    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7117a2b0-e564-451b-a827-7e4587853047-tls-certs\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.210771 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.210722    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpd48\" (UniqueName: \"kubernetes.io/projected/7117a2b0-e564-451b-a827-7e4587853047-kube-api-access-bpd48\") pod \"kube-auth-proxy-7b66dcfb4c-2t28m\" (UID: \"7117a2b0-e564-451b-a827-7e4587853047\") " pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.283677 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.283654    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"
Sep 16 13:36:48.557259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:48.557237    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m"]
Sep 16 13:36:48.558965 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:36:48.558933    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7117a2b0_e564_451b_a827_7e4587853047.slice/crio-6ec7d7deba2f4a6225a5190363f88f3bc06d356bb31ad37c6d3d1b0711af49cf WatchSource:0}: Error finding container 6ec7d7deba2f4a6225a5190363f88f3bc06d356bb31ad37c6d3d1b0711af49cf: Status 404 returned error can't find the container with id 6ec7d7deba2f4a6225a5190363f88f3bc06d356bb31ad37c6d3d1b0711af49cf
Sep 16 13:36:49.408430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.408399    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m" event={"ID":"7117a2b0-e564-451b-a827-7e4587853047","Type":"ContainerStarted","Data":"6ec7d7deba2f4a6225a5190363f88f3bc06d356bb31ad37c6d3d1b0711af49cf"}
Sep 16 13:36:49.795593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.795562    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"]
Sep 16 13:36:49.798766 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.798750    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.801811 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.801788    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 13:36:49.801944 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.801812    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 13:36:49.801944 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.801817    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c84zq\""
Sep 16 13:36:49.802167 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.802144    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 13:36:49.802167 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.802156    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 13:36:49.826079 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.826055    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"]
Sep 16 13:36:49.911412 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911377    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.911580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911458    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.911580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911494    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b2bec61-54a5-4538-b920-ccace28f3028-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.911580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911529    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.911580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911572    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.911794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911626    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffcdm\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-kube-api-access-ffcdm\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:49.911794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:49.911676    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012503 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012471    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012671 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012535    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012671 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012587    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b2bec61-54a5-4538-b920-ccace28f3028-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012671 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012614    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012671 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012640    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012671 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffcdm\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-kube-api-access-ffcdm\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.012931 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.012698    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.013342 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.013314    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.015390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.015366    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b2bec61-54a5-4538-b920-ccace28f3028-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.015494 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.015408    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.015579 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.015526    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.015644 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.015614    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.022198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.022179    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.022555 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.022509    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffcdm\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-kube-api-access-ffcdm\") pod \"istiod-openshift-gateway-7b7995d5cd-zbwms\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.110200 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.110132    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:50.409505 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:50.409478    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"]
Sep 16 13:36:50.412719 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:36:50.412680    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2bec61_54a5_4538_b920_ccace28f3028.slice/crio-051d84a717b8256fbbbf8317cdb6ff53e4f888ab1ba9fcb50ddc90b61e01042a WatchSource:0}: Error finding container 051d84a717b8256fbbbf8317cdb6ff53e4f888ab1ba9fcb50ddc90b61e01042a: Status 404 returned error can't find the container with id 051d84a717b8256fbbbf8317cdb6ff53e4f888ab1ba9fcb50ddc90b61e01042a
Sep 16 13:36:51.422632 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:51.422593    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" event={"ID":"4b2bec61-54a5-4538-b920-ccace28f3028","Type":"ContainerStarted","Data":"051d84a717b8256fbbbf8317cdb6ff53e4f888ab1ba9fcb50ddc90b61e01042a"}
Sep 16 13:36:52.428506 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:52.428464    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m" event={"ID":"7117a2b0-e564-451b-a827-7e4587853047","Type":"ContainerStarted","Data":"525140bef5ffa58d35528baa84ad1e981e5f1548d3fe2eca45414f9b729d4ed3"}
Sep 16 13:36:52.463633 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:52.463521    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b66dcfb4c-2t28m" podStartSLOduration=1.83857985 podStartE2EDuration="5.463500914s" totalImagesPullingTime="3.624921064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:36:52.462912946 +0000 UTC m=+357.216603068" watchObservedRunningTime="2026-09-16 13:36:52.463500914 +0000 UTC m=+357.217191033"
Sep 16 13:36:54.588674 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:54.588638    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:36:54.588939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:54.588707    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:36:55.448914 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:55.448862    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" event={"ID":"4b2bec61-54a5-4538-b920-ccace28f3028","Type":"ContainerStarted","Data":"5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7"}
Sep 16 13:36:55.449264 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:55.449231    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:55.450965 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:55.450928    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zbwms container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:36:55.451108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:55.450991    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" podUID="4b2bec61-54a5-4538-b920-ccace28f3028" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:36:56.453413 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:56.453386    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:36:56.483283 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:56.483234    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" podStartSLOduration=3.310218673 podStartE2EDuration="7.483221082s" totalImagesPullingTime="4.173002409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:36:55.48674552 +0000 UTC m=+360.240435641" watchObservedRunningTime="2026-09-16 13:36:56.483221082 +0000 UTC m=+361.236911203"
Sep 16 13:36:57.268651 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.268616    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qhwv6"]
Sep 16 13:36:57.273497 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.273482    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.286452 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.286434    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qvnkr\""
Sep 16 13:36:57.289618 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.289605    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 13:36:57.298255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.298235    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qhwv6"]
Sep 16 13:36:57.375926 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.375899    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fa8c1d-eda0-49ad-bf37-4235619cabbf-cert\") pod \"odh-model-controller-7998c67dc4-qhwv6\" (UID: \"e4fa8c1d-eda0-49ad-bf37-4235619cabbf\") " pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.376029 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.375985    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98slr\" (UniqueName: \"kubernetes.io/projected/e4fa8c1d-eda0-49ad-bf37-4235619cabbf-kube-api-access-98slr\") pod \"odh-model-controller-7998c67dc4-qhwv6\" (UID: \"e4fa8c1d-eda0-49ad-bf37-4235619cabbf\") " pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.476574 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.476538    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98slr\" (UniqueName: \"kubernetes.io/projected/e4fa8c1d-eda0-49ad-bf37-4235619cabbf-kube-api-access-98slr\") pod \"odh-model-controller-7998c67dc4-qhwv6\" (UID: \"e4fa8c1d-eda0-49ad-bf37-4235619cabbf\") " pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.476896 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.476593    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fa8c1d-eda0-49ad-bf37-4235619cabbf-cert\") pod \"odh-model-controller-7998c67dc4-qhwv6\" (UID: \"e4fa8c1d-eda0-49ad-bf37-4235619cabbf\") " pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.478823 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.478803    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fa8c1d-eda0-49ad-bf37-4235619cabbf-cert\") pod \"odh-model-controller-7998c67dc4-qhwv6\" (UID: \"e4fa8c1d-eda0-49ad-bf37-4235619cabbf\") " pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.509986 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.509954    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98slr\" (UniqueName: \"kubernetes.io/projected/e4fa8c1d-eda0-49ad-bf37-4235619cabbf-kube-api-access-98slr\") pod \"odh-model-controller-7998c67dc4-qhwv6\" (UID: \"e4fa8c1d-eda0-49ad-bf37-4235619cabbf\") " pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.583086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.583030    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:36:57.864412 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:57.864343    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qhwv6"]
Sep 16 13:36:57.867514 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:36:57.867488    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4fa8c1d_eda0_49ad_bf37_4235619cabbf.slice/crio-03cf5c2261ac39e91ee25038dbb570c0fb5d0ec12d0f07d385fa785ea54229d3 WatchSource:0}: Error finding container 03cf5c2261ac39e91ee25038dbb570c0fb5d0ec12d0f07d385fa785ea54229d3: Status 404 returned error can't find the container with id 03cf5c2261ac39e91ee25038dbb570c0fb5d0ec12d0f07d385fa785ea54229d3
Sep 16 13:36:58.005164 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.005136    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t7mcf"]
Sep 16 13:36:58.009909 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.009887    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.017794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.017773    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 13:36:58.031804 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.031782    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t7mcf"]
Sep 16 13:36:58.183807 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.183749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nl4\" (UniqueName: \"kubernetes.io/projected/b4b3e934-430f-473a-a119-6fbe46045bba-kube-api-access-w9nl4\") pod \"model-serving-api-54d89bd5fc-t7mcf\" (UID: \"b4b3e934-430f-473a-a119-6fbe46045bba\") " pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.183807 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.183782    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b3e934-430f-473a-a119-6fbe46045bba-tls-certs\") pod \"model-serving-api-54d89bd5fc-t7mcf\" (UID: \"b4b3e934-430f-473a-a119-6fbe46045bba\") " pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.284665 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.284641    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nl4\" (UniqueName: \"kubernetes.io/projected/b4b3e934-430f-473a-a119-6fbe46045bba-kube-api-access-w9nl4\") pod \"model-serving-api-54d89bd5fc-t7mcf\" (UID: \"b4b3e934-430f-473a-a119-6fbe46045bba\") " pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.284770 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.284674    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b3e934-430f-473a-a119-6fbe46045bba-tls-certs\") pod \"model-serving-api-54d89bd5fc-t7mcf\" (UID: \"b4b3e934-430f-473a-a119-6fbe46045bba\") " pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.287060 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.287035    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b3e934-430f-473a-a119-6fbe46045bba-tls-certs\") pod \"model-serving-api-54d89bd5fc-t7mcf\" (UID: \"b4b3e934-430f-473a-a119-6fbe46045bba\") " pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.293865 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.293845    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nl4\" (UniqueName: \"kubernetes.io/projected/b4b3e934-430f-473a-a119-6fbe46045bba-kube-api-access-w9nl4\") pod \"model-serving-api-54d89bd5fc-t7mcf\" (UID: \"b4b3e934-430f-473a-a119-6fbe46045bba\") " pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.320794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.320775    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:36:58.462408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.462345    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6" event={"ID":"e4fa8c1d-eda0-49ad-bf37-4235619cabbf","Type":"ContainerStarted","Data":"03cf5c2261ac39e91ee25038dbb570c0fb5d0ec12d0f07d385fa785ea54229d3"}
Sep 16 13:36:58.596231 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:58.596204    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-t7mcf"]
Sep 16 13:36:58.599215 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:36:58.599187    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3e934_430f_473a_a119_6fbe46045bba.slice/crio-d2ae7268a61acc5ece4d9d83ba8f2a69580116b7fc7650d2d540a71564f58a53 WatchSource:0}: Error finding container d2ae7268a61acc5ece4d9d83ba8f2a69580116b7fc7650d2d540a71564f58a53: Status 404 returned error can't find the container with id d2ae7268a61acc5ece4d9d83ba8f2a69580116b7fc7650d2d540a71564f58a53
Sep 16 13:36:59.470247 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:59.470184    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf" event={"ID":"b4b3e934-430f-473a-a119-6fbe46045bba","Type":"ContainerStarted","Data":"d2ae7268a61acc5ece4d9d83ba8f2a69580116b7fc7650d2d540a71564f58a53"}
Sep 16 13:36:59.994367 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:59.994337    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86c8679bf9-zh495"]
Sep 16 13:36:59.997762 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:36:59.997740    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.000762 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.000738    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 13:37:00.000898 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.000881    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 13:37:00.001099 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.001078    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 13:37:00.001194 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.001176    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 13:37:00.002319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.002299    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 13:37:00.002428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.002345    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 13:37:00.002619 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.002603    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j4xqz\""
Sep 16 13:37:00.003843 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.003735    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 13:37:00.009217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.009194    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 13:37:00.015198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.015176    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c8679bf9-zh495"]
Sep 16 13:37:00.101593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101532    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-service-ca\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.101768 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101628    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhbss\" (UniqueName: \"kubernetes.io/projected/5575490f-d00b-4e16-98ec-6aec0b5de309-kube-api-access-nhbss\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.101768 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101673    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-console-config\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.101768 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101691    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-oauth-serving-cert\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.101768 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101718    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-trusted-ca-bundle\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.101993 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101831    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5575490f-d00b-4e16-98ec-6aec0b5de309-console-oauth-config\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.101993 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.101880    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5575490f-d00b-4e16-98ec-6aec0b5de309-console-serving-cert\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.202799 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202765    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-service-ca\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.202979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202825    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbss\" (UniqueName: \"kubernetes.io/projected/5575490f-d00b-4e16-98ec-6aec0b5de309-kube-api-access-nhbss\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.202979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202861    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-console-config\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.202979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202884    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-oauth-serving-cert\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.202979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202913    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-trusted-ca-bundle\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.202979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202939    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5575490f-d00b-4e16-98ec-6aec0b5de309-console-oauth-config\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.203241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.202987    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5575490f-d00b-4e16-98ec-6aec0b5de309-console-serving-cert\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.203531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.203504    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-service-ca\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.203677 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.203642    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-console-config\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.203846 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.203823    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-oauth-serving-cert\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.203974 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.203953    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5575490f-d00b-4e16-98ec-6aec0b5de309-trusted-ca-bundle\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.205536 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.205513    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5575490f-d00b-4e16-98ec-6aec0b5de309-console-serving-cert\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.205647 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.205631    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5575490f-d00b-4e16-98ec-6aec0b5de309-console-oauth-config\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.212282 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.212255    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhbss\" (UniqueName: \"kubernetes.io/projected/5575490f-d00b-4e16-98ec-6aec0b5de309-kube-api-access-nhbss\") pod \"console-86c8679bf9-zh495\" (UID: \"5575490f-d00b-4e16-98ec-6aec0b5de309\") " pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:00.309355 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:00.309322    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:01.413099 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.413071    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c8679bf9-zh495"]
Sep 16 13:37:01.415001 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:37:01.414975    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5575490f_d00b_4e16_98ec_6aec0b5de309.slice/crio-3b71ed8f12d72f4abd455ad37756710ea2c79a644c5c929312a2cf069c7330c3 WatchSource:0}: Error finding container 3b71ed8f12d72f4abd455ad37756710ea2c79a644c5c929312a2cf069c7330c3: Status 404 returned error can't find the container with id 3b71ed8f12d72f4abd455ad37756710ea2c79a644c5c929312a2cf069c7330c3
Sep 16 13:37:01.480163 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.480136    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf" event={"ID":"b4b3e934-430f-473a-a119-6fbe46045bba","Type":"ContainerStarted","Data":"c7b180873f6de51fa867207c0b31c1679501c7d1e3a5b85d08f69601919d19c1"}
Sep 16 13:37:01.480270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.480238    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:37:01.482056 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.482026    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6" event={"ID":"e4fa8c1d-eda0-49ad-bf37-4235619cabbf","Type":"ContainerStarted","Data":"30dd45ca9108fed3dfe37df4b90a5bb045fa14b1d6c3db2f19dbfe2c081813d2"}
Sep 16 13:37:01.482169 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.482137    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:37:01.483592 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.483568    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c8679bf9-zh495" event={"ID":"5575490f-d00b-4e16-98ec-6aec0b5de309","Type":"ContainerStarted","Data":"3b71ed8f12d72f4abd455ad37756710ea2c79a644c5c929312a2cf069c7330c3"}
Sep 16 13:37:01.504110 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.504057    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf" podStartSLOduration=1.960602253 podStartE2EDuration="4.504038891s" totalImagesPullingTime="2.543436638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:37:01.502491384 +0000 UTC m=+366.256181506" watchObservedRunningTime="2026-09-16 13:37:01.504038891 +0000 UTC m=+366.257729013"
Sep 16 13:37:01.537492 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:01.537434    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6" podStartSLOduration=1.261188202 podStartE2EDuration="4.537413783s" totalImagesPullingTime="3.276225581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:37:01.536734325 +0000 UTC m=+366.290424448" watchObservedRunningTime="2026-09-16 13:37:01.537413783 +0000 UTC m=+366.291103905"
Sep 16 13:37:02.489625 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:02.489590    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c8679bf9-zh495" event={"ID":"5575490f-d00b-4e16-98ec-6aec0b5de309","Type":"ContainerStarted","Data":"284da639777049c6e82e0dc567b9d0b7c9b07bfdd85c476215d77960c6120f5d"}
Sep 16 13:37:02.514591 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:02.514533    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86c8679bf9-zh495" podStartSLOduration=3.514518774 podStartE2EDuration="3.514518774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:37:02.513188562 +0000 UTC m=+367.266878696" watchObservedRunningTime="2026-09-16 13:37:02.514518774 +0000 UTC m=+367.268208895"
Sep 16 13:37:05.407286 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.407253    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"]
Sep 16 13:37:05.410756 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.410739    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.430160 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.430136    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"]
Sep 16 13:37:05.549835 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.549803    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.549968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.549863    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.549968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.549886    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.549968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.549901    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.549968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.549915    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mq6s\" (UniqueName: \"kubernetes.io/projected/be6598e1-7f38-4554-b886-b4ff67aa4f86-kube-api-access-2mq6s\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.549968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.549931    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6598e1-7f38-4554-b886-b4ff67aa4f86-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.550136 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.550015    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650292    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650320    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650336    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650351    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mq6s\" (UniqueName: \"kubernetes.io/projected/be6598e1-7f38-4554-b886-b4ff67aa4f86-kube-api-access-2mq6s\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650367    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6598e1-7f38-4554-b886-b4ff67aa4f86-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650411    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.650459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.650437    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.651276 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.651249    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.652784 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.652763    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6598e1-7f38-4554-b886-b4ff67aa4f86-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.652901 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.652886    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.652974 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.652958    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.653011 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.652969    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.660604 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.660532    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mq6s\" (UniqueName: \"kubernetes.io/projected/be6598e1-7f38-4554-b886-b4ff67aa4f86-kube-api-access-2mq6s\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.661224 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.661200    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6598e1-7f38-4554-b886-b4ff67aa4f86-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wptls\" (UID: \"be6598e1-7f38-4554-b886-b4ff67aa4f86\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:05.719136 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:05.719113    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:06.029375 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.029354    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"]
Sep 16 13:37:06.030873 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:37:06.030851    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6598e1_7f38_4554_b886_b4ff67aa4f86.slice/crio-6ca50e2d9cb8eee12ecfdde8aded0bea525836f35ebb788c6cb3e6aacdaaf3ed WatchSource:0}: Error finding container 6ca50e2d9cb8eee12ecfdde8aded0bea525836f35ebb788c6cb3e6aacdaaf3ed: Status 404 returned error can't find the container with id 6ca50e2d9cb8eee12ecfdde8aded0bea525836f35ebb788c6cb3e6aacdaaf3ed
Sep 16 13:37:06.033024 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.032996    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:37:06.033098 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.033053    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:37:06.510235 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.510206    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls" event={"ID":"be6598e1-7f38-4554-b886-b4ff67aa4f86","Type":"ContainerStarted","Data":"f1c359f83db36a9f7067fc641cd5a7aec82416e9f722836bcc384540475ffd75"}
Sep 16 13:37:06.510609 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.510252    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls" event={"ID":"be6598e1-7f38-4554-b886-b4ff67aa4f86","Type":"ContainerStarted","Data":"6ca50e2d9cb8eee12ecfdde8aded0bea525836f35ebb788c6cb3e6aacdaaf3ed"}
Sep 16 13:37:06.510609 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.510354    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:06.536275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:06.536235    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls" podStartSLOduration=1.536223058 podStartE2EDuration="1.536223058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:37:06.531904322 +0000 UTC m=+371.285594444" watchObservedRunningTime="2026-09-16 13:37:06.536223058 +0000 UTC m=+371.289913178"
Sep 16 13:37:07.516924 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:07.516892    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-wptls container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:37:07.517271 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:07.516944    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls" podUID="be6598e1-7f38-4554-b886-b4ff67aa4f86" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:37:10.310230 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.310191    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:10.310613 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.310252    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:10.315026 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.315003    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:10.516658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.516631    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wptls"
Sep 16 13:37:10.532011 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.531987    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86c8679bf9-zh495"
Sep 16 13:37:10.739874 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.739795    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"]
Sep 16 13:37:10.740057 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.740007    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" podUID="4b2bec61-54a5-4538-b920-ccace28f3028" containerName="discovery" containerID="cri-o://5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7" gracePeriod=30
Sep 16 13:37:10.996710 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:10.996653    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:37:11.091962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.091934    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-kubeconfig\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.091986    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-ca-configmap\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.092011    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b2bec61-54a5-4538-b920-ccace28f3028-local-certs\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.092042    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-istio-token\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.092064    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffcdm\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-kube-api-access-ffcdm\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.092100    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-cacerts\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092360 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.092138    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-dns-cert\") pod \"4b2bec61-54a5-4538-b920-ccace28f3028\" (UID: \"4b2bec61-54a5-4538-b920-ccace28f3028\") "
Sep 16 13:37:11.092462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.092427    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:37:11.094376 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.094346    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:37:11.094499 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.094468    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-kube-api-access-ffcdm" (OuterVolumeSpecName: "kube-api-access-ffcdm") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "kube-api-access-ffcdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:37:11.094726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.094702    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:37:11.094726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.094713    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b2bec61-54a5-4538-b920-ccace28f3028-local-certs" (OuterVolumeSpecName: "local-certs") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:37:11.094939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.094918    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:37:11.094939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.094933    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-cacerts" (OuterVolumeSpecName: "cacerts") pod "4b2bec61-54a5-4538-b920-ccace28f3028" (UID: "4b2bec61-54a5-4538-b920-ccace28f3028"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:37:11.192888 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192867    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-ca-configmap\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.192888 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192887    2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b2bec61-54a5-4538-b920-ccace28f3028-local-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.192989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192896    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.192989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192903    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffcdm\" (UniqueName: \"kubernetes.io/projected/4b2bec61-54a5-4538-b920-ccace28f3028-kube-api-access-ffcdm\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.192989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192911    2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-cacerts\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.192989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192919    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-csr-dns-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.192989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.192927    2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b2bec61-54a5-4538-b920-ccace28f3028-istio-kubeconfig\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:37:11.534212 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.534179    2552 generic.go:356] "Generic (PLEG): container finished" podID="4b2bec61-54a5-4538-b920-ccace28f3028" containerID="5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7" exitCode=0
Sep 16 13:37:11.534690 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.534231    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"
Sep 16 13:37:11.534690 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.534261    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" event={"ID":"4b2bec61-54a5-4538-b920-ccace28f3028","Type":"ContainerDied","Data":"5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7"}
Sep 16 13:37:11.534690 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.534305    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms" event={"ID":"4b2bec61-54a5-4538-b920-ccace28f3028","Type":"ContainerDied","Data":"051d84a717b8256fbbbf8317cdb6ff53e4f888ab1ba9fcb50ddc90b61e01042a"}
Sep 16 13:37:11.534690 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.534324    2552 scope.go:117] "RemoveContainer" containerID="5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7"
Sep 16 13:37:11.542839 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.542823    2552 scope.go:117] "RemoveContainer" containerID="5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7"
Sep 16 13:37:11.543093 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:37:11.543077    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7\": container with ID starting with 5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7 not found: ID does not exist" containerID="5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7"
Sep 16 13:37:11.543132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.543103    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7"} err="failed to get container status \"5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7\": rpc error: code = NotFound desc = could not find container \"5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7\": container with ID starting with 5cf380bb36e20b9e6f0e5ac0c791b8089603bbfe78215074852b844d631704d7 not found: ID does not exist"
Sep 16 13:37:11.564902 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.564881    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"]
Sep 16 13:37:11.568894 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.568875    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zbwms"]
Sep 16 13:37:11.836968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:11.836890    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2bec61-54a5-4538-b920-ccace28f3028" path="/var/lib/kubelet/pods/4b2bec61-54a5-4538-b920-ccace28f3028/volumes"
Sep 16 13:37:12.491977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:12.491951    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qhwv6"
Sep 16 13:37:12.493942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:37:12.493916    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-t7mcf"
Sep 16 13:38:18.491213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.491139    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"]
Sep 16 13:38:18.491607 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.491451    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b2bec61-54a5-4538-b920-ccace28f3028" containerName="discovery"
Sep 16 13:38:18.491607 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.491462    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2bec61-54a5-4538-b920-ccace28f3028" containerName="discovery"
Sep 16 13:38:18.491607 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.491518    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b2bec61-54a5-4538-b920-ccace28f3028" containerName="discovery"
Sep 16 13:38:18.495070 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.495053    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.497861 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.497845    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-677kh\""
Sep 16 13:38:18.498889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.498869    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 13:38:18.498995 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.498977    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 13:38:18.520345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.520317    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"]
Sep 16 13:38:18.595080 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.595036    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.595229 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.595145    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbm2r\" (UniqueName: \"kubernetes.io/projected/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-kube-api-access-rbm2r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.695860 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.695832    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.695994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.695965    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbm2r\" (UniqueName: \"kubernetes.io/projected/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-kube-api-access-rbm2r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.696242 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.696219    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.711994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.711976    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbm2r\" (UniqueName: \"kubernetes.io/projected/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-kube-api-access-rbm2r\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:18.805146 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:18.805119    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:19.089400 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:19.089377    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"]
Sep 16 13:38:19.091795 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:38:19.091769    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a09eb31_ac7d_4910_8219_9c455bf0eb9a.slice/crio-290dba06c3efe35fea3b9935b03518b7cc78ad91b75a2dc421a9cbd2fd6d8996 WatchSource:0}: Error finding container 290dba06c3efe35fea3b9935b03518b7cc78ad91b75a2dc421a9cbd2fd6d8996: Status 404 returned error can't find the container with id 290dba06c3efe35fea3b9935b03518b7cc78ad91b75a2dc421a9cbd2fd6d8996
Sep 16 13:38:19.839897 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:19.839865    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f" event={"ID":"5a09eb31-ac7d-4910-8219-9c455bf0eb9a","Type":"ContainerStarted","Data":"290dba06c3efe35fea3b9935b03518b7cc78ad91b75a2dc421a9cbd2fd6d8996"}
Sep 16 13:38:21.242915 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.242879    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-cdmx5"]
Sep 16 13:38:21.253657 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.253632    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:21.256989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.256776    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-d7vls\""
Sep 16 13:38:21.284099 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.284035    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-cdmx5"]
Sep 16 13:38:21.421348 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.421315    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqcv2\" (UniqueName: \"kubernetes.io/projected/0f6fafbe-468a-4420-a615-47e7748d52f0-kube-api-access-jqcv2\") pod \"authorino-operator-76b478bd78-cdmx5\" (UID: \"0f6fafbe-468a-4420-a615-47e7748d52f0\") " pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:21.522182 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.522144    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqcv2\" (UniqueName: \"kubernetes.io/projected/0f6fafbe-468a-4420-a615-47e7748d52f0-kube-api-access-jqcv2\") pod \"authorino-operator-76b478bd78-cdmx5\" (UID: \"0f6fafbe-468a-4420-a615-47e7748d52f0\") " pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:21.541713 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.541685    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqcv2\" (UniqueName: \"kubernetes.io/projected/0f6fafbe-468a-4420-a615-47e7748d52f0-kube-api-access-jqcv2\") pod \"authorino-operator-76b478bd78-cdmx5\" (UID: \"0f6fafbe-468a-4420-a615-47e7748d52f0\") " pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:21.568468 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.568444    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:21.868809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:21.868786    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-cdmx5"]
Sep 16 13:38:22.975667 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:38:22.975636    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6fafbe_468a_4420_a615_47e7748d52f0.slice/crio-9377627f2ad9bd64dd43b6145d756e7f1a8229c0f29f642c04308135af8b3c1b WatchSource:0}: Error finding container 9377627f2ad9bd64dd43b6145d756e7f1a8229c0f29f642c04308135af8b3c1b: Status 404 returned error can't find the container with id 9377627f2ad9bd64dd43b6145d756e7f1a8229c0f29f642c04308135af8b3c1b
Sep 16 13:38:23.864317 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:23.864270    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f" event={"ID":"5a09eb31-ac7d-4910-8219-9c455bf0eb9a","Type":"ContainerStarted","Data":"3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34"}
Sep 16 13:38:23.864508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:23.864347    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:23.866009 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:23.865981    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5" event={"ID":"0f6fafbe-468a-4420-a615-47e7748d52f0","Type":"ContainerStarted","Data":"9377627f2ad9bd64dd43b6145d756e7f1a8229c0f29f642c04308135af8b3c1b"}
Sep 16 13:38:23.895121 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:23.895075    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f" podStartSLOduration=1.9455487329999999 podStartE2EDuration="5.895061664s" totalImagesPullingTime="3.949512931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:23.892767624 +0000 UTC m=+448.646457748" watchObservedRunningTime="2026-09-16 13:38:23.895061664 +0000 UTC m=+448.648751784"
Sep 16 13:38:24.872211 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:24.872172    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5" event={"ID":"0f6fafbe-468a-4420-a615-47e7748d52f0","Type":"ContainerStarted","Data":"053d8235706d5dcf739258eaee1541c9dfb04ffdff6fa1da2029dd1c2bb97080"}
Sep 16 13:38:24.872649 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:24.872229    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:24.903685 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:24.903640    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5" podStartSLOduration=2.541300537 podStartE2EDuration="3.903625528s" totalImagesPullingTime="1.362324991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:24.901410257 +0000 UTC m=+449.655100377" watchObservedRunningTime="2026-09-16 13:38:24.903625528 +0000 UTC m=+449.657315650"
Sep 16 13:38:34.874921 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:34.874893    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:35.879630 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:35.879600    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-cdmx5"
Sep 16 13:38:38.144939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.144902    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"]
Sep 16 13:38:38.145390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.145094    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" containerName="manager" containerID="cri-o://3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34" gracePeriod=2
Sep 16 13:38:38.146677 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.146651    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"]
Sep 16 13:38:38.173345 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:38.173304    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:38.198177 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.198150    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"]
Sep 16 13:38:38.198487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.198475    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" containerName="manager"
Sep 16 13:38:38.198531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.198490    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" containerName="manager"
Sep 16 13:38:38.198593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.198539    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" containerName="manager"
Sep 16 13:38:38.201504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.201485    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.215746 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:38.215721    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:38.251221 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.251198    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"]
Sep 16 13:38:38.263584 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.263507    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b11cb6a-4a71-4e7e-af38-575a31112b68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cs49\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.263671 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.263651    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pms74\" (UniqueName: \"kubernetes.io/projected/2b11cb6a-4a71-4e7e-af38-575a31112b68-kube-api-access-pms74\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cs49\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.364929 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.364901    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pms74\" (UniqueName: \"kubernetes.io/projected/2b11cb6a-4a71-4e7e-af38-575a31112b68-kube-api-access-pms74\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cs49\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.365099 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.364957    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b11cb6a-4a71-4e7e-af38-575a31112b68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cs49\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.365293 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.365277    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b11cb6a-4a71-4e7e-af38-575a31112b68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cs49\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.388899 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.388878    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:38.391384 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.391362    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pms74\" (UniqueName: \"kubernetes.io/projected/2b11cb6a-4a71-4e7e-af38-575a31112b68-kube-api-access-pms74\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7cs49\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.399060 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:38.399004    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:38.465947 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.465923    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-extensions-socket-volume\") pod \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") "
Sep 16 13:38:38.466038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.465968    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbm2r\" (UniqueName: \"kubernetes.io/projected/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-kube-api-access-rbm2r\") pod \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\" (UID: \"5a09eb31-ac7d-4910-8219-9c455bf0eb9a\") "
Sep 16 13:38:38.466390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.466370    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a09eb31-ac7d-4910-8219-9c455bf0eb9a" (UID: "5a09eb31-ac7d-4910-8219-9c455bf0eb9a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:38:38.467922 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.467901    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-kube-api-access-rbm2r" (OuterVolumeSpecName: "kube-api-access-rbm2r") pod "5a09eb31-ac7d-4910-8219-9c455bf0eb9a" (UID: "5a09eb31-ac7d-4910-8219-9c455bf0eb9a"). InnerVolumeSpecName "kube-api-access-rbm2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:38:38.521116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.521094    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.567691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.567661    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-extensions-socket-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:38:38.567806 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.567696    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbm2r\" (UniqueName: \"kubernetes.io/projected/5a09eb31-ac7d-4910-8219-9c455bf0eb9a-kube-api-access-rbm2r\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:38:38.828316 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.828286    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"]
Sep 16 13:38:38.831821 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:38:38.831792    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b11cb6a_4a71_4e7e_af38_575a31112b68.slice/crio-04dd891edf5705e46ca95e6042abccc07edb3623f0f76cf2297bba7f666eba99 WatchSource:0}: Error finding container 04dd891edf5705e46ca95e6042abccc07edb3623f0f76cf2297bba7f666eba99: Status 404 returned error can't find the container with id 04dd891edf5705e46ca95e6042abccc07edb3623f0f76cf2297bba7f666eba99
Sep 16 13:38:38.930069 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.930041    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49" event={"ID":"2b11cb6a-4a71-4e7e-af38-575a31112b68","Type":"ContainerStarted","Data":"7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa"}
Sep 16 13:38:38.930205 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.930085    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49" event={"ID":"2b11cb6a-4a71-4e7e-af38-575a31112b68","Type":"ContainerStarted","Data":"04dd891edf5705e46ca95e6042abccc07edb3623f0f76cf2297bba7f666eba99"}
Sep 16 13:38:38.930205 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.930143    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:38.931520 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.931496    2552 generic.go:356] "Generic (PLEG): container finished" podID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" containerID="3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34" exitCode=0
Sep 16 13:38:38.931621 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.931534    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:38.931621 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.931554    2552 scope.go:117] "RemoveContainer" containerID="3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34"
Sep 16 13:38:38.942780 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.942763    2552 scope.go:117] "RemoveContainer" containerID="3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34"
Sep 16 13:38:38.943083 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:38.943067    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34\": container with ID starting with 3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34 not found: ID does not exist" containerID="3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34"
Sep 16 13:38:38.943131 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.943090    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34"} err="failed to get container status \"3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34\": rpc error: code = NotFound desc = could not find container \"3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34\": container with ID starting with 3a60148d73ecbbabe4f0eff4ed0b00811bc85b779ede09b53e3a66344fb68b34 not found: ID does not exist"
Sep 16 13:38:38.985378 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:38.985332    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49" podStartSLOduration=0.985319611 podStartE2EDuration="985.319611ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:38.983143493 +0000 UTC m=+463.736833616" watchObservedRunningTime="2026-09-16 13:38:38.985319611 +0000 UTC m=+463.739009731"
Sep 16 13:38:38.985704 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:38.985673    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:38.988581 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:38.988558    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-rmx8f\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rmx8f"
Sep 16 13:38:39.837234 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:39.837202    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a09eb31-ac7d-4910-8219-9c455bf0eb9a" path="/var/lib/kubelet/pods/5a09eb31-ac7d-4910-8219-9c455bf0eb9a/volumes"
Sep 16 13:38:40.743352 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.743314    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"]
Sep 16 13:38:40.748286 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.748261    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:40.765534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.765506    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"]
Sep 16 13:38:40.782535 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.782510    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2kz7\" (UniqueName: \"kubernetes.io/projected/f2689c0f-ce49-4897-bd88-4bcf163f56a8-kube-api-access-x2kz7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xp5gh\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:40.782709 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.782581    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2689c0f-ce49-4897-bd88-4bcf163f56a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xp5gh\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:40.883141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.883118    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2kz7\" (UniqueName: \"kubernetes.io/projected/f2689c0f-ce49-4897-bd88-4bcf163f56a8-kube-api-access-x2kz7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xp5gh\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:40.883433 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.883176    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2689c0f-ce49-4897-bd88-4bcf163f56a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xp5gh\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:40.883485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.883460    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2689c0f-ce49-4897-bd88-4bcf163f56a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xp5gh\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:40.900380 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:40.900360    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2kz7\" (UniqueName: \"kubernetes.io/projected/f2689c0f-ce49-4897-bd88-4bcf163f56a8-kube-api-access-x2kz7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xp5gh\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:41.058819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:41.058787    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:41.344218 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:41.344153    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"]
Sep 16 13:38:41.347497 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:38:41.347475    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2689c0f_ce49_4897_bd88_4bcf163f56a8.slice/crio-315b61ff86a5b9a44c2f81e48572f6fd2a88563f3406febe9684eaf7da9393cc WatchSource:0}: Error finding container 315b61ff86a5b9a44c2f81e48572f6fd2a88563f3406febe9684eaf7da9393cc: Status 404 returned error can't find the container with id 315b61ff86a5b9a44c2f81e48572f6fd2a88563f3406febe9684eaf7da9393cc
Sep 16 13:38:41.947887 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:41.947856    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh" event={"ID":"f2689c0f-ce49-4897-bd88-4bcf163f56a8","Type":"ContainerStarted","Data":"23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156"}
Sep 16 13:38:41.948356 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:41.947904    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh" event={"ID":"f2689c0f-ce49-4897-bd88-4bcf163f56a8","Type":"ContainerStarted","Data":"315b61ff86a5b9a44c2f81e48572f6fd2a88563f3406febe9684eaf7da9393cc"}
Sep 16 13:38:41.948356 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:41.947936    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:41.980565 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:41.980501    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh" podStartSLOduration=1.980486431 podStartE2EDuration="1.980486431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:38:41.97766126 +0000 UTC m=+466.731351402" watchObservedRunningTime="2026-09-16 13:38:41.980486431 +0000 UTC m=+466.734176555"
Sep 16 13:38:49.938772 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:49.938740    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:52.954831 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:52.954800    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 13:38:53.020656 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.020625    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"]
Sep 16 13:38:53.020828 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.020806    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49" podUID="2b11cb6a-4a71-4e7e-af38-575a31112b68" containerName="manager" containerID="cri-o://7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa" gracePeriod=10
Sep 16 13:38:53.260568 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.260534    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:53.379713 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.379684    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b11cb6a-4a71-4e7e-af38-575a31112b68-extensions-socket-volume\") pod \"2b11cb6a-4a71-4e7e-af38-575a31112b68\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") "
Sep 16 13:38:53.379841 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.379719    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pms74\" (UniqueName: \"kubernetes.io/projected/2b11cb6a-4a71-4e7e-af38-575a31112b68-kube-api-access-pms74\") pod \"2b11cb6a-4a71-4e7e-af38-575a31112b68\" (UID: \"2b11cb6a-4a71-4e7e-af38-575a31112b68\") "
Sep 16 13:38:53.380022 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.380001    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b11cb6a-4a71-4e7e-af38-575a31112b68-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b11cb6a-4a71-4e7e-af38-575a31112b68" (UID: "2b11cb6a-4a71-4e7e-af38-575a31112b68"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:38:53.381569 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.381530    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b11cb6a-4a71-4e7e-af38-575a31112b68-kube-api-access-pms74" (OuterVolumeSpecName: "kube-api-access-pms74") pod "2b11cb6a-4a71-4e7e-af38-575a31112b68" (UID: "2b11cb6a-4a71-4e7e-af38-575a31112b68"). InnerVolumeSpecName "kube-api-access-pms74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:38:53.481040 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.481017    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b11cb6a-4a71-4e7e-af38-575a31112b68-extensions-socket-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:38:53.481040 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:53.481039    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pms74\" (UniqueName: \"kubernetes.io/projected/2b11cb6a-4a71-4e7e-af38-575a31112b68-kube-api-access-pms74\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:38:54.004254 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.004224    2552 generic.go:356] "Generic (PLEG): container finished" podID="2b11cb6a-4a71-4e7e-af38-575a31112b68" containerID="7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa" exitCode=0
Sep 16 13:38:54.004598 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.004267    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"
Sep 16 13:38:54.004598 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.004268    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49" event={"ID":"2b11cb6a-4a71-4e7e-af38-575a31112b68","Type":"ContainerDied","Data":"7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa"}
Sep 16 13:38:54.004598 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.004412    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49" event={"ID":"2b11cb6a-4a71-4e7e-af38-575a31112b68","Type":"ContainerDied","Data":"04dd891edf5705e46ca95e6042abccc07edb3623f0f76cf2297bba7f666eba99"}
Sep 16 13:38:54.004598 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.004447    2552 scope.go:117] "RemoveContainer" containerID="7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa"
Sep 16 13:38:54.012968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.012951    2552 scope.go:117] "RemoveContainer" containerID="7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa"
Sep 16 13:38:54.013265 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:38:54.013237    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa\": container with ID starting with 7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa not found: ID does not exist" containerID="7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa"
Sep 16 13:38:54.013319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.013273    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa"} err="failed to get container status \"7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa\": rpc error: code = NotFound desc = could not find container \"7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa\": container with ID starting with 7185c8c662372ebe5ff510c61175524bf847e9c541c803b89a44b705304f38aa not found: ID does not exist"
Sep 16 13:38:54.031407 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.031387    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"]
Sep 16 13:38:54.035125 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:54.035105    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7cs49"]
Sep 16 13:38:55.837665 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:38:55.837636    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b11cb6a-4a71-4e7e-af38-575a31112b68" path="/var/lib/kubelet/pods/2b11cb6a-4a71-4e7e-af38-575a31112b68/volumes"
Sep 16 13:39:11.969641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.969605    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:11.970117 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.970098    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b11cb6a-4a71-4e7e-af38-575a31112b68" containerName="manager"
Sep 16 13:39:11.970165 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.970120    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b11cb6a-4a71-4e7e-af38-575a31112b68" containerName="manager"
Sep 16 13:39:11.970223 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.970211    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b11cb6a-4a71-4e7e-af38-575a31112b68" containerName="manager"
Sep 16 13:39:11.975209 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.975185    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:11.978025 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.977991    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 13:39:11.978306 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.978291    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8r4wt\""
Sep 16 13:39:11.987218 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:11.987194    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:12.056620 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.056588    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:12.128669 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.128630    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ac5b410-8c92-465d-86a0-23fb35c562b7-config-file\") pod \"limitador-limitador-8588749977-pb9wk\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") " pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.128866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.128753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dmb\" (UniqueName: \"kubernetes.io/projected/8ac5b410-8c92-465d-86a0-23fb35c562b7-kube-api-access-h9dmb\") pod \"limitador-limitador-8588749977-pb9wk\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") " pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.229449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.229382    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dmb\" (UniqueName: \"kubernetes.io/projected/8ac5b410-8c92-465d-86a0-23fb35c562b7-kube-api-access-h9dmb\") pod \"limitador-limitador-8588749977-pb9wk\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") " pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.229449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.229434    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ac5b410-8c92-465d-86a0-23fb35c562b7-config-file\") pod \"limitador-limitador-8588749977-pb9wk\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") " pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.230055 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.230030    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ac5b410-8c92-465d-86a0-23fb35c562b7-config-file\") pod \"limitador-limitador-8588749977-pb9wk\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") " pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.237901 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.237869    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dmb\" (UniqueName: \"kubernetes.io/projected/8ac5b410-8c92-465d-86a0-23fb35c562b7-kube-api-access-h9dmb\") pod \"limitador-limitador-8588749977-pb9wk\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") " pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.288511 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.288482    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:12.562915 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:12.562891    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:12.565361 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:39:12.565336    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac5b410_8c92_465d_86a0_23fb35c562b7.slice/crio-8a012ab12af8223c3f326e9fb23aab17af43ce48e70f6883d62ae535dcd40445 WatchSource:0}: Error finding container 8a012ab12af8223c3f326e9fb23aab17af43ce48e70f6883d62ae535dcd40445: Status 404 returned error can't find the container with id 8a012ab12af8223c3f326e9fb23aab17af43ce48e70f6883d62ae535dcd40445
Sep 16 13:39:13.092639 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:13.092605    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk" event={"ID":"8ac5b410-8c92-465d-86a0-23fb35c562b7","Type":"ContainerStarted","Data":"8a012ab12af8223c3f326e9fb23aab17af43ce48e70f6883d62ae535dcd40445"}
Sep 16 13:39:14.098070 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:14.097963    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk" event={"ID":"8ac5b410-8c92-465d-86a0-23fb35c562b7","Type":"ContainerStarted","Data":"8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613"}
Sep 16 13:39:14.098070 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:14.098058    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:14.118694 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:14.118651    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk" podStartSLOduration=1.903747922 podStartE2EDuration="3.118637483s" totalImagesPullingTime="1.214889561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:39:14.11818968 +0000 UTC m=+498.871879812" watchObservedRunningTime="2026-09-16 13:39:14.118637483 +0000 UTC m=+498.872327604"
Sep 16 13:39:25.103666 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:25.103634    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:27.476021 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:27.475987    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:27.476388 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:27.476212    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk" podUID="8ac5b410-8c92-465d-86a0-23fb35c562b7" containerName="limitador" containerID="cri-o://8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613" gracePeriod=30
Sep 16 13:39:28.017789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.017767    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:28.054625 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.054564    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9dmb\" (UniqueName: \"kubernetes.io/projected/8ac5b410-8c92-465d-86a0-23fb35c562b7-kube-api-access-h9dmb\") pod \"8ac5b410-8c92-465d-86a0-23fb35c562b7\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") "
Sep 16 13:39:28.054625 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.054618    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ac5b410-8c92-465d-86a0-23fb35c562b7-config-file\") pod \"8ac5b410-8c92-465d-86a0-23fb35c562b7\" (UID: \"8ac5b410-8c92-465d-86a0-23fb35c562b7\") "
Sep 16 13:39:28.054961 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.054940    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac5b410-8c92-465d-86a0-23fb35c562b7-config-file" (OuterVolumeSpecName: "config-file") pod "8ac5b410-8c92-465d-86a0-23fb35c562b7" (UID: "8ac5b410-8c92-465d-86a0-23fb35c562b7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:39:28.056533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.056512    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac5b410-8c92-465d-86a0-23fb35c562b7-kube-api-access-h9dmb" (OuterVolumeSpecName: "kube-api-access-h9dmb") pod "8ac5b410-8c92-465d-86a0-23fb35c562b7" (UID: "8ac5b410-8c92-465d-86a0-23fb35c562b7"). InnerVolumeSpecName "kube-api-access-h9dmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:39:28.156233 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.156197    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9dmb\" (UniqueName: \"kubernetes.io/projected/8ac5b410-8c92-465d-86a0-23fb35c562b7-kube-api-access-h9dmb\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:39:28.156233 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.156226    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ac5b410-8c92-465d-86a0-23fb35c562b7-config-file\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:39:28.161369 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.161342    2552 generic.go:356] "Generic (PLEG): container finished" podID="8ac5b410-8c92-465d-86a0-23fb35c562b7" containerID="8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613" exitCode=0
Sep 16 13:39:28.161473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.161383    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk"
Sep 16 13:39:28.161473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.161403    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk" event={"ID":"8ac5b410-8c92-465d-86a0-23fb35c562b7","Type":"ContainerDied","Data":"8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613"}
Sep 16 13:39:28.161473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.161449    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pb9wk" event={"ID":"8ac5b410-8c92-465d-86a0-23fb35c562b7","Type":"ContainerDied","Data":"8a012ab12af8223c3f326e9fb23aab17af43ce48e70f6883d62ae535dcd40445"}
Sep 16 13:39:28.161473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.161472    2552 scope.go:117] "RemoveContainer" containerID="8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613"
Sep 16 13:39:28.169761 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.169747    2552 scope.go:117] "RemoveContainer" containerID="8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613"
Sep 16 13:39:28.170003 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:39:28.169986    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613\": container with ID starting with 8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613 not found: ID does not exist" containerID="8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613"
Sep 16 13:39:28.170059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.170011    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613"} err="failed to get container status \"8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613\": rpc error: code = NotFound desc = could not find container \"8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613\": container with ID starting with 8da6b102a8d5c1f0ee47bdeee75b1de5603acad8345d6d3ae432e31d5929d613 not found: ID does not exist"
Sep 16 13:39:28.183757 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.183737    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:28.188242 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:28.188224    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pb9wk"]
Sep 16 13:39:29.836949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:29.836915    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac5b410-8c92-465d-86a0-23fb35c562b7" path="/var/lib/kubelet/pods/8ac5b410-8c92-465d-86a0-23fb35c562b7/volumes"
Sep 16 13:39:33.872259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.872229    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"]
Sep 16 13:39:33.875738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.873321    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac5b410-8c92-465d-86a0-23fb35c562b7" containerName="limitador"
Sep 16 13:39:33.875738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.873355    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac5b410-8c92-465d-86a0-23fb35c562b7" containerName="limitador"
Sep 16 13:39:33.875738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.873580    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac5b410-8c92-465d-86a0-23fb35c562b7" containerName="limitador"
Sep 16 13:39:33.878216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.878186    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:33.882099 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.882074    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 13:39:33.882213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.882075    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7p6kc\""
Sep 16 13:39:33.882213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.882168    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 13:39:33.883306 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.883292    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 13:39:33.896786 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.896761    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/086f5664-b535-4b52-bcf1-35b585b0907c-data\") pod \"postgres-69fb4594cf-zmvc6\" (UID: \"086f5664-b535-4b52-bcf1-35b585b0907c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:33.896919 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.896827    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72kk\" (UniqueName: \"kubernetes.io/projected/086f5664-b535-4b52-bcf1-35b585b0907c-kube-api-access-x72kk\") pod \"postgres-69fb4594cf-zmvc6\" (UID: \"086f5664-b535-4b52-bcf1-35b585b0907c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:33.898700 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.898679    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"]
Sep 16 13:39:33.997495 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.997468    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/086f5664-b535-4b52-bcf1-35b585b0907c-data\") pod \"postgres-69fb4594cf-zmvc6\" (UID: \"086f5664-b535-4b52-bcf1-35b585b0907c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:33.997663 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.997510    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72kk\" (UniqueName: \"kubernetes.io/projected/086f5664-b535-4b52-bcf1-35b585b0907c-kube-api-access-x72kk\") pod \"postgres-69fb4594cf-zmvc6\" (UID: \"086f5664-b535-4b52-bcf1-35b585b0907c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:33.997892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:33.997870    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/086f5664-b535-4b52-bcf1-35b585b0907c-data\") pod \"postgres-69fb4594cf-zmvc6\" (UID: \"086f5664-b535-4b52-bcf1-35b585b0907c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:34.006824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:34.006805    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72kk\" (UniqueName: \"kubernetes.io/projected/086f5664-b535-4b52-bcf1-35b585b0907c-kube-api-access-x72kk\") pod \"postgres-69fb4594cf-zmvc6\" (UID: \"086f5664-b535-4b52-bcf1-35b585b0907c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:34.190144 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:34.190084    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:34.468185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:34.468161    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"]
Sep 16 13:39:34.470083 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:39:34.470051    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086f5664_b535_4b52_bcf1_35b585b0907c.slice/crio-84a8f51ce935c83b02daece07bac2e821c7fc3658c20037c1f6b847aa38b11a2 WatchSource:0}: Error finding container 84a8f51ce935c83b02daece07bac2e821c7fc3658c20037c1f6b847aa38b11a2: Status 404 returned error can't find the container with id 84a8f51ce935c83b02daece07bac2e821c7fc3658c20037c1f6b847aa38b11a2
Sep 16 13:39:35.193363 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:35.193325    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6" event={"ID":"086f5664-b535-4b52-bcf1-35b585b0907c","Type":"ContainerStarted","Data":"84a8f51ce935c83b02daece07bac2e821c7fc3658c20037c1f6b847aa38b11a2"}
Sep 16 13:39:40.218862 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:40.218821    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6" event={"ID":"086f5664-b535-4b52-bcf1-35b585b0907c","Type":"ContainerStarted","Data":"5026f17e7d5d5ba7ae534fbee0a07658d015d81018458de38b9457069cbb57dd"}
Sep 16 13:39:40.219217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:40.218940    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:40.239024 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:40.238980    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6" podStartSLOduration=2.308522852 podStartE2EDuration="7.238965872s" totalImagesPullingTime="4.93044302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:39:40.237857257 +0000 UTC m=+524.991547381" watchObservedRunningTime="2026-09-16 13:39:40.238965872 +0000 UTC m=+524.992655990"
Sep 16 13:39:46.251992 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:46.251956    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zmvc6"
Sep 16 13:39:53.766720 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.766646    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84f899d64b-pclb6"]
Sep 16 13:39:53.770289 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.770270    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.775717 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.775696    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p88z6\""
Sep 16 13:39:53.775866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.775753    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 13:39:53.775960 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.775946    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 13:39:53.776792 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.776776    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 13:39:53.785821 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.785802    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f899d64b-pclb6"]
Sep 16 13:39:53.857353 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.857323    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwc94\" (UniqueName: \"kubernetes.io/projected/d2f869e5-fbe9-46e4-a127-092fae4c63ca-kube-api-access-lwc94\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.857477 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.857358    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.857477 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.857385    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.931010 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.930978    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b987c86d7-776hm"]
Sep 16 13:39:53.934586 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.934567    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:53.943389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.943368    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-776hm"]
Sep 16 13:39:53.958007 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.957984    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwc94\" (UniqueName: \"kubernetes.io/projected/d2f869e5-fbe9-46e4-a127-092fae4c63ca-kube-api-access-lwc94\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.958122 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.958055    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.958186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.958172    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:53.958281 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:39:53.958258    2552 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 16 13:39:53.958385 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:39:53.958317    2552 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 16 13:39:53.958385 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:39:53.958335    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert podName:d2f869e5-fbe9-46e4-a127-092fae4c63ca nodeName:}" failed. No retries permitted until 2026-09-16 13:39:54.458317607 +0000 UTC m=+539.212007711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert") pod "maas-controller-84f899d64b-pclb6" (UID: "d2f869e5-fbe9-46e4-a127-092fae4c63ca") : secret "maas-controller-webhook-cert" not found
Sep 16 13:39:53.958385 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:39:53.958362    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs podName:d2f869e5-fbe9-46e4-a127-092fae4c63ca nodeName:}" failed. No retries permitted until 2026-09-16 13:39:54.458346892 +0000 UTC m=+539.212036996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs") pod "maas-controller-84f899d64b-pclb6" (UID: "d2f869e5-fbe9-46e4-a127-092fae4c63ca") : secret "maas-controller-metrics-tls" not found
Sep 16 13:39:53.972750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:53.972727    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwc94\" (UniqueName: \"kubernetes.io/projected/d2f869e5-fbe9-46e4-a127-092fae4c63ca-kube-api-access-lwc94\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:54.058689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.058637    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-webhook-cert\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.058773 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.058702    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xl82\" (UniqueName: \"kubernetes.io/projected/1bb85fdd-c001-4f33-b586-52de70118cdb-kube-api-access-8xl82\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.058773 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.058744    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-metrics-certs\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.159663 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.159639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-webhook-cert\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.159762 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.159704    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xl82\" (UniqueName: \"kubernetes.io/projected/1bb85fdd-c001-4f33-b586-52de70118cdb-kube-api-access-8xl82\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.159762 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.159722    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-metrics-certs\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.161978 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.161961    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-metrics-certs\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.162077 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.162001    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-webhook-cert\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.169204 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.169185    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xl82\" (UniqueName: \"kubernetes.io/projected/1bb85fdd-c001-4f33-b586-52de70118cdb-kube-api-access-8xl82\") pod \"maas-controller-5b987c86d7-776hm\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") " pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.245304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.245278    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:54.462062 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.461985    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:54.462062 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.462033    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:54.464299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.464274    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:54.464402 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.464318    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs\") pod \"maas-controller-84f899d64b-pclb6\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") " pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:54.518441 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.518417    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-776hm"]
Sep 16 13:39:54.520180 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:39:54.520156    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb85fdd_c001_4f33_b586_52de70118cdb.slice/crio-0406301d7f4d64e048ebe31169bb70279569c95d2a7d737404ea61ac6c639687 WatchSource:0}: Error finding container 0406301d7f4d64e048ebe31169bb70279569c95d2a7d737404ea61ac6c639687: Status 404 returned error can't find the container with id 0406301d7f4d64e048ebe31169bb70279569c95d2a7d737404ea61ac6c639687
Sep 16 13:39:54.682359 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.682340    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:54.953553 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:54.953517    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f899d64b-pclb6"]
Sep 16 13:39:54.955107 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:39:54.955078    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f869e5_fbe9_46e4_a127_092fae4c63ca.slice/crio-8f86d7a9c0431a57f9e5280b1a39b73a1164b4f99a76113e08b5cd652918bb0e WatchSource:0}: Error finding container 8f86d7a9c0431a57f9e5280b1a39b73a1164b4f99a76113e08b5cd652918bb0e: Status 404 returned error can't find the container with id 8f86d7a9c0431a57f9e5280b1a39b73a1164b4f99a76113e08b5cd652918bb0e
Sep 16 13:39:55.286220 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:55.286183    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-776hm" event={"ID":"1bb85fdd-c001-4f33-b586-52de70118cdb","Type":"ContainerStarted","Data":"0406301d7f4d64e048ebe31169bb70279569c95d2a7d737404ea61ac6c639687"}
Sep 16 13:39:55.288085 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:55.288015    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f899d64b-pclb6" event={"ID":"d2f869e5-fbe9-46e4-a127-092fae4c63ca","Type":"ContainerStarted","Data":"8f86d7a9c0431a57f9e5280b1a39b73a1164b4f99a76113e08b5cd652918bb0e"}
Sep 16 13:39:57.203182 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.203159    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 13:39:57.301638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.301589    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-776hm" event={"ID":"1bb85fdd-c001-4f33-b586-52de70118cdb","Type":"ContainerStarted","Data":"06b449d6d4ac1517f7a5eaf81ff46d4b8250aad4ac36609916375c3ef4207e0e"}
Sep 16 13:39:57.301767 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.301682    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:39:57.303419 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.303393    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f899d64b-pclb6" event={"ID":"d2f869e5-fbe9-46e4-a127-092fae4c63ca","Type":"ContainerStarted","Data":"e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89"}
Sep 16 13:39:57.303570 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.303437    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:39:57.325396 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.325359    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b987c86d7-776hm" podStartSLOduration=1.6467370890000002 podStartE2EDuration="4.325346344s" totalImagesPullingTime="2.678609255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:39:57.324347329 +0000 UTC m=+542.078037449" watchObservedRunningTime="2026-09-16 13:39:57.325346344 +0000 UTC m=+542.079036499"
Sep 16 13:39:57.347485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:39:57.347445    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84f899d64b-pclb6" podStartSLOduration=2.097122105 podStartE2EDuration="4.347431119s" totalImagesPullingTime="2.250309014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:39:57.345375973 +0000 UTC m=+542.099066096" watchObservedRunningTime="2026-09-16 13:39:57.347431119 +0000 UTC m=+542.101121240"
Sep 16 13:40:08.309849 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.309816    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:40:08.310320 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.310059    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 13:40:08.388756 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.388720    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f899d64b-pclb6"]
Sep 16 13:40:08.388933 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.388910    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-84f899d64b-pclb6" podUID="d2f869e5-fbe9-46e4-a127-092fae4c63ca" containerName="manager" containerID="cri-o://e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89" gracePeriod=30
Sep 16 13:40:08.635163 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.635138    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:40:08.781395 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.781369    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwc94\" (UniqueName: \"kubernetes.io/projected/d2f869e5-fbe9-46e4-a127-092fae4c63ca-kube-api-access-lwc94\") pod \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") "
Sep 16 13:40:08.781534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.781427    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert\") pod \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") "
Sep 16 13:40:08.781534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.781448    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs\") pod \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\" (UID: \"d2f869e5-fbe9-46e4-a127-092fae4c63ca\") "
Sep 16 13:40:08.783533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.783506    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d2f869e5-fbe9-46e4-a127-092fae4c63ca" (UID: "d2f869e5-fbe9-46e4-a127-092fae4c63ca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:40:08.783533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.783518    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f869e5-fbe9-46e4-a127-092fae4c63ca-kube-api-access-lwc94" (OuterVolumeSpecName: "kube-api-access-lwc94") pod "d2f869e5-fbe9-46e4-a127-092fae4c63ca" (UID: "d2f869e5-fbe9-46e4-a127-092fae4c63ca"). InnerVolumeSpecName "kube-api-access-lwc94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:40:08.783533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.783533    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d2f869e5-fbe9-46e4-a127-092fae4c63ca" (UID: "d2f869e5-fbe9-46e4-a127-092fae4c63ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:40:08.882185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.882111    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-webhook-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:40:08.882185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.882145    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2f869e5-fbe9-46e4-a127-092fae4c63ca-metrics-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:40:08.882185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:08.882160    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwc94\" (UniqueName: \"kubernetes.io/projected/d2f869e5-fbe9-46e4-a127-092fae4c63ca-kube-api-access-lwc94\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:40:09.357510 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.357475    2552 generic.go:356] "Generic (PLEG): container finished" podID="d2f869e5-fbe9-46e4-a127-092fae4c63ca" containerID="e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89" exitCode=0
Sep 16 13:40:09.357907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.357528    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f899d64b-pclb6"
Sep 16 13:40:09.357907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.357528    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f899d64b-pclb6" event={"ID":"d2f869e5-fbe9-46e4-a127-092fae4c63ca","Type":"ContainerDied","Data":"e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89"}
Sep 16 13:40:09.357907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.357616    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f899d64b-pclb6" event={"ID":"d2f869e5-fbe9-46e4-a127-092fae4c63ca","Type":"ContainerDied","Data":"8f86d7a9c0431a57f9e5280b1a39b73a1164b4f99a76113e08b5cd652918bb0e"}
Sep 16 13:40:09.357907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.357648    2552 scope.go:117] "RemoveContainer" containerID="e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89"
Sep 16 13:40:09.366326 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.366311    2552 scope.go:117] "RemoveContainer" containerID="e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89"
Sep 16 13:40:09.366632 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:40:09.366614    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89\": container with ID starting with e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89 not found: ID does not exist" containerID="e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89"
Sep 16 13:40:09.366688 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.366640    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89"} err="failed to get container status \"e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89\": rpc error: code = NotFound desc = could not find container \"e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89\": container with ID starting with e127629a180c6c837888e24c4c04ba1ab86fd715aafc2f8a6f275bd8c38fbd89 not found: ID does not exist"
Sep 16 13:40:09.379320 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.379296    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f899d64b-pclb6"]
Sep 16 13:40:09.384595 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.384575    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84f899d64b-pclb6"]
Sep 16 13:40:09.837504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:09.837473    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f869e5-fbe9-46e4-a127-092fae4c63ca" path="/var/lib/kubelet/pods/d2f869e5-fbe9-46e4-a127-092fae4c63ca/volumes"
Sep 16 13:40:31.490908 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.490875    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"]
Sep 16 13:40:31.491358 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.491198    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f869e5-fbe9-46e4-a127-092fae4c63ca" containerName="manager"
Sep 16 13:40:31.491358 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.491211    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f869e5-fbe9-46e4-a127-092fae4c63ca" containerName="manager"
Sep 16 13:40:31.491358 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.491275    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f869e5-fbe9-46e4-a127-092fae4c63ca" containerName="manager"
Sep 16 13:40:31.493141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.493125    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.497154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.497132    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 13:40:31.521250 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.521228    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"]
Sep 16 13:40:31.589102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.589075    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"]
Sep 16 13:40:31.591275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.591261    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.597411 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.597389    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4zcq2\""
Sep 16 13:40:31.614797 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.614773    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"]
Sep 16 13:40:31.656205 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.656182    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a230a65-c16a-47f7-a6d1-b2bdf21172ef-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zwf8d\" (UID: \"9a230a65-c16a-47f7-a6d1-b2bdf21172ef\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.656335 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.656215    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4vm\" (UniqueName: \"kubernetes.io/projected/9a230a65-c16a-47f7-a6d1-b2bdf21172ef-kube-api-access-4t4vm\") pod \"payload-pre-processing-59fbc47bf8-zwf8d\" (UID: \"9a230a65-c16a-47f7-a6d1-b2bdf21172ef\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.757466 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.757437    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a230a65-c16a-47f7-a6d1-b2bdf21172ef-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zwf8d\" (UID: \"9a230a65-c16a-47f7-a6d1-b2bdf21172ef\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.757716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.757490    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4vm\" (UniqueName: \"kubernetes.io/projected/9a230a65-c16a-47f7-a6d1-b2bdf21172ef-kube-api-access-4t4vm\") pod \"payload-pre-processing-59fbc47bf8-zwf8d\" (UID: \"9a230a65-c16a-47f7-a6d1-b2bdf21172ef\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.757716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.757598    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7453cbbd-6a0d-4c00-9d10-72457dbdc457-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9zkpq\" (UID: \"7453cbbd-6a0d-4c00-9d10-72457dbdc457\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.757716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.757649    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvkr\" (UniqueName: \"kubernetes.io/projected/7453cbbd-6a0d-4c00-9d10-72457dbdc457-kube-api-access-wnvkr\") pod \"payload-processing-5b54b7fbb7-9zkpq\" (UID: \"7453cbbd-6a0d-4c00-9d10-72457dbdc457\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.758969 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.758946    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a230a65-c16a-47f7-a6d1-b2bdf21172ef-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zwf8d\" (UID: \"9a230a65-c16a-47f7-a6d1-b2bdf21172ef\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.766904 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.766878    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4vm\" (UniqueName: \"kubernetes.io/projected/9a230a65-c16a-47f7-a6d1-b2bdf21172ef-kube-api-access-4t4vm\") pod \"payload-pre-processing-59fbc47bf8-zwf8d\" (UID: \"9a230a65-c16a-47f7-a6d1-b2bdf21172ef\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.803249 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.803221    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:31.860096 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.860066    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7453cbbd-6a0d-4c00-9d10-72457dbdc457-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9zkpq\" (UID: \"7453cbbd-6a0d-4c00-9d10-72457dbdc457\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.860208 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.860109    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvkr\" (UniqueName: \"kubernetes.io/projected/7453cbbd-6a0d-4c00-9d10-72457dbdc457-kube-api-access-wnvkr\") pod \"payload-processing-5b54b7fbb7-9zkpq\" (UID: \"7453cbbd-6a0d-4c00-9d10-72457dbdc457\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.861012 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.860966    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7453cbbd-6a0d-4c00-9d10-72457dbdc457-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9zkpq\" (UID: \"7453cbbd-6a0d-4c00-9d10-72457dbdc457\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.874947 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.874885    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvkr\" (UniqueName: \"kubernetes.io/projected/7453cbbd-6a0d-4c00-9d10-72457dbdc457-kube-api-access-wnvkr\") pod \"payload-processing-5b54b7fbb7-9zkpq\" (UID: \"7453cbbd-6a0d-4c00-9d10-72457dbdc457\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:31.903408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:31.903379    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:32.081695 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:32.081672    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"]
Sep 16 13:40:32.083642 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:40:32.083613    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a230a65_c16a_47f7_a6d1_b2bdf21172ef.slice/crio-d2e9214501a41a208f68269e9e3a4ca679b9db05e7255b6e676a211fcdacdca2 WatchSource:0}: Error finding container d2e9214501a41a208f68269e9e3a4ca679b9db05e7255b6e676a211fcdacdca2: Status 404 returned error can't find the container with id d2e9214501a41a208f68269e9e3a4ca679b9db05e7255b6e676a211fcdacdca2
Sep 16 13:40:32.180973 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:32.180947    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"]
Sep 16 13:40:32.183395 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:40:32.183368    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7453cbbd_6a0d_4c00_9d10_72457dbdc457.slice/crio-1b8bb9203668f08f4d1bf7cc6df74eed3544a5bdc98d3d66f295abd43b6ce503 WatchSource:0}: Error finding container 1b8bb9203668f08f4d1bf7cc6df74eed3544a5bdc98d3d66f295abd43b6ce503: Status 404 returned error can't find the container with id 1b8bb9203668f08f4d1bf7cc6df74eed3544a5bdc98d3d66f295abd43b6ce503
Sep 16 13:40:32.459336 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:32.459255    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d" event={"ID":"9a230a65-c16a-47f7-a6d1-b2bdf21172ef","Type":"ContainerStarted","Data":"d2e9214501a41a208f68269e9e3a4ca679b9db05e7255b6e676a211fcdacdca2"}
Sep 16 13:40:32.460397 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:32.460366    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq" event={"ID":"7453cbbd-6a0d-4c00-9d10-72457dbdc457","Type":"ContainerStarted","Data":"1b8bb9203668f08f4d1bf7cc6df74eed3544a5bdc98d3d66f295abd43b6ce503"}
Sep 16 13:40:35.480818 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:35.480779    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d" event={"ID":"9a230a65-c16a-47f7-a6d1-b2bdf21172ef","Type":"ContainerStarted","Data":"23fb3d047d832141b01760177b66c8725f47118531c7ed513782976fe1fb4c62"}
Sep 16 13:40:35.481280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:35.480970    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:35.482462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:35.482438    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq" event={"ID":"7453cbbd-6a0d-4c00-9d10-72457dbdc457","Type":"ContainerStarted","Data":"b3013e404079059e96eea4236f099fce856f6bcc3c0eea1a86e8f46a05d602df"}
Sep 16 13:40:35.482581 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:35.482487    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:35.501520 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:35.501471    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d" podStartSLOduration=1.914233716 podStartE2EDuration="4.501455922s" totalImagesPullingTime="2.587222206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:40:35.498410569 +0000 UTC m=+580.252100691" watchObservedRunningTime="2026-09-16 13:40:35.501455922 +0000 UTC m=+580.255146043"
Sep 16 13:40:35.519648 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:35.519603    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq" podStartSLOduration=2.041248957 podStartE2EDuration="4.519585042s" totalImagesPullingTime="2.478336085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:40:35.518015763 +0000 UTC m=+580.271705886" watchObservedRunningTime="2026-09-16 13:40:35.519585042 +0000 UTC m=+580.273275165"
Sep 16 13:40:46.489705 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:46.489677    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zwf8d"
Sep 16 13:40:46.490181 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:46.489741    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9zkpq"
Sep 16 13:40:55.623920 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:55.623897    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:40:55.624278 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:55.623902    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:40:57.778287 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.778258    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"]
Sep 16 13:40:57.782312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.782285    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.788068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.788040    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m5ll2\""
Sep 16 13:40:57.788221 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.788200    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 13:40:57.788287 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.788219    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 13:40:57.788361 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.788344    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 13:40:57.798657 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.798631    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"]
Sep 16 13:40:57.864670 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.864637    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.864822 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.864680    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.864822 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.864787    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.864906 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.864826    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4355c98-8856-40bd-8c30-890fe9f38e8d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.864978 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.864959    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5799m\" (UniqueName: \"kubernetes.io/projected/c4355c98-8856-40bd-8c30-890fe9f38e8d-kube-api-access-5799m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.865030 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.865016    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.965907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.965867    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.965927    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4355c98-8856-40bd-8c30-890fe9f38e8d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966001    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5799m\" (UniqueName: \"kubernetes.io/projected/c4355c98-8856-40bd-8c30-890fe9f38e8d-kube-api-access-5799m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966086 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966047    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966085    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966111    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966140    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966406 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966361    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.966469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.966453    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.968232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.968198    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4355c98-8856-40bd-8c30-890fe9f38e8d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.968428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.968410    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4355c98-8856-40bd-8c30-890fe9f38e8d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:57.974902 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:57.974883    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5799m\" (UniqueName: \"kubernetes.io/projected/c4355c98-8856-40bd-8c30-890fe9f38e8d-kube-api-access-5799m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x525r\" (UID: \"c4355c98-8856-40bd-8c30-890fe9f38e8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:58.098568 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:58.098462    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:40:58.399028 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:58.398954    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"]
Sep 16 13:40:58.401689 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:40:58.401661    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4355c98_8856_40bd_8c30_890fe9f38e8d.slice/crio-a048e03e162d685a730c9ab0001d48533843964d1af189d04b9efc38c4f55bc1 WatchSource:0}: Error finding container a048e03e162d685a730c9ab0001d48533843964d1af189d04b9efc38c4f55bc1: Status 404 returned error can't find the container with id a048e03e162d685a730c9ab0001d48533843964d1af189d04b9efc38c4f55bc1
Sep 16 13:40:58.591265 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:58.591232    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r" event={"ID":"c4355c98-8856-40bd-8c30-890fe9f38e8d","Type":"ContainerStarted","Data":"a048e03e162d685a730c9ab0001d48533843964d1af189d04b9efc38c4f55bc1"}
Sep 16 13:40:59.597890 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:59.597858    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r" event={"ID":"c4355c98-8856-40bd-8c30-890fe9f38e8d","Type":"ContainerStarted","Data":"0c5b1b162f030b9a9b2698d8def6a28445aa335672a56300a3d155b62acde21b"}
Sep 16 13:40:59.619958 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:40:59.619908    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r" podStartSLOduration=1.5942526190000001 podStartE2EDuration="2.619892669s" totalImagesPullingTime="1.02564005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:40:59.618437318 +0000 UTC m=+604.372127450" watchObservedRunningTime="2026-09-16 13:40:59.619892669 +0000 UTC m=+604.373582787"
Sep 16 13:41:04.282395 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.282355    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"]
Sep 16 13:41:04.285238 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.285220    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.288028 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.288010    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 13:41:04.298826 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.298804    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"]
Sep 16 13:41:04.418085 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.418056    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.418085 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.418091    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397e7194-240e-4eec-adb4-34090dbec440-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.418312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.418129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.418312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.418157    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.418312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.418194    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.418312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.418292    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7477\" (UniqueName: \"kubernetes.io/projected/397e7194-240e-4eec-adb4-34090dbec440-kube-api-access-c7477\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519150 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519122    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519159    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519200    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519258    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7477\" (UniqueName: \"kubernetes.io/projected/397e7194-240e-4eec-adb4-34090dbec440-kube-api-access-c7477\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519299    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519323    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397e7194-240e-4eec-adb4-34090dbec440-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519626 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519587    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519626 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519613    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.519732 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.519666    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.521633 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.521614    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397e7194-240e-4eec-adb4-34090dbec440-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.522011 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.521991    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397e7194-240e-4eec-adb4-34090dbec440-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.531591 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.531566    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7477\" (UniqueName: \"kubernetes.io/projected/397e7194-240e-4eec-adb4-34090dbec440-kube-api-access-c7477\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg\" (UID: \"397e7194-240e-4eec-adb4-34090dbec440\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.595584 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.595499    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:04.879711 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:04.879686    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"]
Sep 16 13:41:04.881314 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:41:04.881286    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397e7194_240e_4eec_adb4_34090dbec440.slice/crio-b95de3901aad533e76319abdb68c7ef76e5ee86b603c0405f043b7ec7c6ab273 WatchSource:0}: Error finding container b95de3901aad533e76319abdb68c7ef76e5ee86b603c0405f043b7ec7c6ab273: Status 404 returned error can't find the container with id b95de3901aad533e76319abdb68c7ef76e5ee86b603c0405f043b7ec7c6ab273
Sep 16 13:41:05.634068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:05.634023    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg" event={"ID":"397e7194-240e-4eec-adb4-34090dbec440","Type":"ContainerStarted","Data":"4e4396b543ad82e7bc578046444f2a5e13da0778f1f485a998f441ffe25e11c8"}
Sep 16 13:41:05.634428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:05.634089    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg" event={"ID":"397e7194-240e-4eec-adb4-34090dbec440","Type":"ContainerStarted","Data":"b95de3901aad533e76319abdb68c7ef76e5ee86b603c0405f043b7ec7c6ab273"}
Sep 16 13:41:05.685336 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:05.685246    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg" podStartSLOduration=1.131622769 podStartE2EDuration="1.685224912s" totalImagesPullingTime="553.602143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:41:05.684435347 +0000 UTC m=+610.438125470" watchObservedRunningTime="2026-09-16 13:41:05.685224912 +0000 UTC m=+610.438915033"
Sep 16 13:41:08.098991 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:08.098958    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:41:08.100444 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:08.099018    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:41:08.111243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:08.111212    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:41:08.659686 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:08.659658    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x525r"
Sep 16 13:41:14.595824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:14.595778    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:14.596209 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:14.595861    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:14.608166 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:14.608145    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:14.689880 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:14.689854    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg"
Sep 16 13:41:38.271673 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.271642    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"]
Sep 16 13:41:38.276649 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.276628    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.279528 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.279508    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 13:41:38.288978 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.288957    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"]
Sep 16 13:41:38.302458 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.302435    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.302564 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.302533    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/460ce62e-583c-4547-af7a-df2644724d9a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.302621 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.302587    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.302621 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.302613    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrjt\" (UniqueName: \"kubernetes.io/projected/460ce62e-583c-4547-af7a-df2644724d9a-kube-api-access-fxrjt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.302716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.302637    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.302716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.302699    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403561 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403520    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403699 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403649    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/460ce62e-583c-4547-af7a-df2644724d9a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403699 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403669    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403699 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403694    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrjt\" (UniqueName: \"kubernetes.io/projected/460ce62e-583c-4547-af7a-df2644724d9a-kube-api-access-fxrjt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403750    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.403944 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.403844    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.404037 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.404022    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.404146 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.404125    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.406073 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.406052    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/460ce62e-583c-4547-af7a-df2644724d9a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.406280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.406262    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/460ce62e-583c-4547-af7a-df2644724d9a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.417601 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.417577    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrjt\" (UniqueName: \"kubernetes.io/projected/460ce62e-583c-4547-af7a-df2644724d9a-kube-api-access-fxrjt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg6pt\" (UID: \"460ce62e-583c-4547-af7a-df2644724d9a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.588722 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.588656    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:38.862311 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.862290    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"]
Sep 16 13:41:38.864226 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:41:38.864201    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460ce62e_583c_4547_af7a_df2644724d9a.slice/crio-7c7d8434aa36aeca816fccd440fe202035ea3ace1dbf4d6494974a38293318bb WatchSource:0}: Error finding container 7c7d8434aa36aeca816fccd440fe202035ea3ace1dbf4d6494974a38293318bb: Status 404 returned error can't find the container with id 7c7d8434aa36aeca816fccd440fe202035ea3ace1dbf4d6494974a38293318bb
Sep 16 13:41:38.865412 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:38.865396    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:41:39.799783 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:39.799753    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt" event={"ID":"460ce62e-583c-4547-af7a-df2644724d9a","Type":"ContainerStarted","Data":"7121407d45a64748e7a1c73a91e3dc7acb47b3ed2b5b095ed8e4942d80453a5d"}
Sep 16 13:41:39.800144 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:39.799831    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt" event={"ID":"460ce62e-583c-4547-af7a-df2644724d9a","Type":"ContainerStarted","Data":"7c7d8434aa36aeca816fccd440fe202035ea3ace1dbf4d6494974a38293318bb"}
Sep 16 13:41:39.820440 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:39.820392    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt" podStartSLOduration=1.611853218 podStartE2EDuration="1.820376982s" totalImagesPullingTime="208.523764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:41:39.818569042 +0000 UTC m=+644.572259163" watchObservedRunningTime="2026-09-16 13:41:39.820376982 +0000 UTC m=+644.574067103"
Sep 16 13:41:48.589285 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:48.589249    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:48.589680 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:48.589303    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:48.602102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:48.602075    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:41:48.855110 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:41:48.855031    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg6pt"
Sep 16 13:43:47.557684 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.557649    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"]
Sep 16 13:43:47.561120 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.561099    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.570787 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.570769    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-46ccbd-openshift-default-dockercfg-dk7hr\""
Sep 16 13:43:47.595776 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.595749    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"]
Sep 16 13:43:47.644926 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.644898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-socket\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645055 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.644931    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-certs\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645055 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.644953    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-envoy\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645055 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.645013    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-istio-token\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645055 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.645040    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvbb9\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-kube-api-access-zvbb9\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.645132    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63816847-5ec3-4a5e-8475-09708f56c80d-istio-podinfo\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.645177    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-data\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645332 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.645279    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-credential-socket\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.645332 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.645298    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63816847-5ec3-4a5e-8475-09708f56c80d-istiod-ca-cert\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746563    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvbb9\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-kube-api-access-zvbb9\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746630    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63816847-5ec3-4a5e-8475-09708f56c80d-istio-podinfo\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746675    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-data\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746885 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746763    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-credential-socket\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746885 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746789    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63816847-5ec3-4a5e-8475-09708f56c80d-istiod-ca-cert\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746885 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746823    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-socket\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.746885 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746843    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-certs\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747094 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.746922    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-envoy\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747094 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.747009    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-istio-token\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747283 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.747207    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-certs\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747402 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.747296    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-data\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.747470    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-credential-socket\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747570 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.747522    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-socket\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.747677 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.747652    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63816847-5ec3-4a5e-8475-09708f56c80d-istiod-ca-cert\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.749299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.749280    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63816847-5ec3-4a5e-8475-09708f56c80d-istio-podinfo\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.749619 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.749604    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-envoy\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.769964 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.769939    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-istio-token\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.770462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.770439    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvbb9\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-kube-api-access-zvbb9\") pod \"e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") " pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:47.871947 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:47.871871    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:48.294213 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:48.294182    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"]
Sep 16 13:43:48.297181 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:43:48.297158    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63816847_5ec3_4a5e_8475_09708f56c80d.slice/crio-f096f86ec82f643401067715e3fc1cb9c022a8c85f37e053989d6b2052f01497 WatchSource:0}: Error finding container f096f86ec82f643401067715e3fc1cb9c022a8c85f37e053989d6b2052f01497: Status 404 returned error can't find the container with id f096f86ec82f643401067715e3fc1cb9c022a8c85f37e053989d6b2052f01497
Sep 16 13:43:48.396154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:48.396119    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" event={"ID":"63816847-5ec3-4a5e-8475-09708f56c80d","Type":"ContainerStarted","Data":"f096f86ec82f643401067715e3fc1cb9c022a8c85f37e053989d6b2052f01497"}
Sep 16 13:43:50.951456 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:50.951421    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:43:50.951842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:50.951502    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:43:50.951842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:50.951583    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:43:51.413176 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:51.413138    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" event={"ID":"63816847-5ec3-4a5e-8475-09708f56c80d","Type":"ContainerStarted","Data":"e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"}
Sep 16 13:43:51.476564 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:51.476494    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podStartSLOduration=1.824463607 podStartE2EDuration="4.476477975s" totalImagesPullingTime="2.652014368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:43:51.476136567 +0000 UTC m=+776.229826689" watchObservedRunningTime="2026-09-16 13:43:51.476477975 +0000 UTC m=+776.230168095"
Sep 16 13:43:51.871948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:51.871912    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:52.878417 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:52.878376    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:53.423400 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:53.423347    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:53.424439 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:53.424421    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:43:56.332526 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.332492    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"]
Sep 16 13:43:56.335799 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.335783    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.338886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.338865    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-aca190\""
Sep 16 13:43:56.375216 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.375176    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"]
Sep 16 13:43:56.432669 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.432642    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6k9r\" (UniqueName: \"kubernetes.io/projected/beac1774-1984-4cfa-a0a0-4f814988643a-kube-api-access-f6k9r\") pod \"payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.432797 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.432770    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beac1774-1984-4cfa-a0a0-4f814988643a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.533737 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.533707    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beac1774-1984-4cfa-a0a0-4f814988643a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.533853 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.533756    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6k9r\" (UniqueName: \"kubernetes.io/projected/beac1774-1984-4cfa-a0a0-4f814988643a-kube-api-access-f6k9r\") pod \"payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.534466 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.534446    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beac1774-1984-4cfa-a0a0-4f814988643a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.550299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.550274    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6k9r\" (UniqueName: \"kubernetes.io/projected/beac1774-1984-4cfa-a0a0-4f814988643a-kube-api-access-f6k9r\") pod \"payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.645737 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.645672    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:56.670567 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.670517    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"]
Sep 16 13:43:56.673903 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.673885    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.681150 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.681133    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-aca190-dockercfg-pg5c9\""
Sep 16 13:43:56.702748 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.702647    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"]
Sep 16 13:43:56.836676 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.836647    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkmd\" (UniqueName: \"kubernetes.io/projected/dfd504e5-dce6-4d18-9412-9aa49a7b1212-kube-api-access-zgkmd\") pod \"payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") " pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.836834 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.836765    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd504e5-dce6-4d18-9412-9aa49a7b1212-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") " pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.938060 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.937960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd504e5-dce6-4d18-9412-9aa49a7b1212-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") " pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.938282 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.938258    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkmd\" (UniqueName: \"kubernetes.io/projected/dfd504e5-dce6-4d18-9412-9aa49a7b1212-kube-api-access-zgkmd\") pod \"payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") " pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.939279 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.939247    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd504e5-dce6-4d18-9412-9aa49a7b1212-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") " pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.942037 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.942008    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"]
Sep 16 13:43:56.943767 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:43:56.943743    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeac1774_1984_4cfa_a0a0_4f814988643a.slice/crio-5d68ca4ee8708f005f4b478b4fa11fe0f59870b5b21dd9af5f35a5b60de9e4ab WatchSource:0}: Error finding container 5d68ca4ee8708f005f4b478b4fa11fe0f59870b5b21dd9af5f35a5b60de9e4ab: Status 404 returned error can't find the container with id 5d68ca4ee8708f005f4b478b4fa11fe0f59870b5b21dd9af5f35a5b60de9e4ab
Sep 16 13:43:56.953797 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.953773    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkmd\" (UniqueName: \"kubernetes.io/projected/dfd504e5-dce6-4d18-9412-9aa49a7b1212-kube-api-access-zgkmd\") pod \"payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") " pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:56.984657 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:56.984631    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:57.290277 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.290253    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"]
Sep 16 13:43:57.292449 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:43:57.292425    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd504e5_dce6_4d18_9412_9aa49a7b1212.slice/crio-a0320fe4ed81fad9b6c6abbb940b65f65769501da2a3129d896aba00c27c116f WatchSource:0}: Error finding container a0320fe4ed81fad9b6c6abbb940b65f65769501da2a3129d896aba00c27c116f: Status 404 returned error can't find the container with id a0320fe4ed81fad9b6c6abbb940b65f65769501da2a3129d896aba00c27c116f
Sep 16 13:43:57.447580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.446844    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6" event={"ID":"beac1774-1984-4cfa-a0a0-4f814988643a","Type":"ContainerStarted","Data":"0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70"}
Sep 16 13:43:57.447580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.446944    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6" event={"ID":"beac1774-1984-4cfa-a0a0-4f814988643a","Type":"ContainerStarted","Data":"5d68ca4ee8708f005f4b478b4fa11fe0f59870b5b21dd9af5f35a5b60de9e4ab"}
Sep 16 13:43:57.448299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.448245    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:43:57.450894 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.450439    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p" event={"ID":"dfd504e5-dce6-4d18-9412-9aa49a7b1212","Type":"ContainerStarted","Data":"7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e"}
Sep 16 13:43:57.450894 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.450487    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p" event={"ID":"dfd504e5-dce6-4d18-9412-9aa49a7b1212","Type":"ContainerStarted","Data":"a0320fe4ed81fad9b6c6abbb940b65f65769501da2a3129d896aba00c27c116f"}
Sep 16 13:43:57.450894 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.450595    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:43:57.482574 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.482500    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6" podStartSLOduration=1.482486497 podStartE2EDuration="1.482486497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:43:57.479775105 +0000 UTC m=+782.233465225" watchObservedRunningTime="2026-09-16 13:43:57.482486497 +0000 UTC m=+782.236176629"
Sep 16 13:43:57.514951 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:57.514906    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p" podStartSLOduration=1.5148895260000002 podStartE2EDuration="1.514889526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:43:57.513284222 +0000 UTC m=+782.266974342" watchObservedRunningTime="2026-09-16 13:43:57.514889526 +0000 UTC m=+782.268579666"
Sep 16 13:43:59.065066 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.065030    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"]
Sep 16 13:43:59.068595 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.068575    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.074265 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.074244    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-46ccbd\""
Sep 16 13:43:59.074397 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.074371    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-46ccbd-dockercfg-6p59g\""
Sep 16 13:43:59.095084 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.095060    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"]
Sep 16 13:43:59.158881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.158852    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a357ba1-a024-4e96-9f7f-dd550d2421ba-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.158881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.158884    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26tcz\" (UniqueName: \"kubernetes.io/projected/6a357ba1-a024-4e96-9f7f-dd550d2421ba-kube-api-access-26tcz\") pod \"payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.259784 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.259752    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a357ba1-a024-4e96-9f7f-dd550d2421ba-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.259784 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.259786    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26tcz\" (UniqueName: \"kubernetes.io/projected/6a357ba1-a024-4e96-9f7f-dd550d2421ba-kube-api-access-26tcz\") pod \"payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.260496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.260478    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a357ba1-a024-4e96-9f7f-dd550d2421ba-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.280314 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.280292    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26tcz\" (UniqueName: \"kubernetes.io/projected/6a357ba1-a024-4e96-9f7f-dd550d2421ba-kube-api-access-26tcz\") pod \"payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.379048 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.378980    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:43:59.759951 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:43:59.759919    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"]
Sep 16 13:43:59.763533 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:43:59.763503    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a357ba1_a024_4e96_9f7f_dd550d2421ba.slice/crio-ab4312052cd214e2b6f64f706531dcfd924ded34d6af0ed7a7d766770a4971b5 WatchSource:0}: Error finding container ab4312052cd214e2b6f64f706531dcfd924ded34d6af0ed7a7d766770a4971b5: Status 404 returned error can't find the container with id ab4312052cd214e2b6f64f706531dcfd924ded34d6af0ed7a7d766770a4971b5
Sep 16 13:44:00.476594 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:00.476557    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5" event={"ID":"6a357ba1-a024-4e96-9f7f-dd550d2421ba","Type":"ContainerStarted","Data":"701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb"}
Sep 16 13:44:00.477057 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:00.476610    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5" event={"ID":"6a357ba1-a024-4e96-9f7f-dd550d2421ba","Type":"ContainerStarted","Data":"ab4312052cd214e2b6f64f706531dcfd924ded34d6af0ed7a7d766770a4971b5"}
Sep 16 13:44:00.477057 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:00.476681    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:44:00.514738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:00.514679    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5" podStartSLOduration=1.514659592 podStartE2EDuration="1.514659592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:00.511967719 +0000 UTC m=+785.265657868" watchObservedRunningTime="2026-09-16 13:44:00.514659592 +0000 UTC m=+785.268349714"
Sep 16 13:44:01.475478 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.475447    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"]
Sep 16 13:44:01.478811 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.478790    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.493069 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.493042    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-4bb29c-dockercfg-xr62j\""
Sep 16 13:44:01.493171 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.493068    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-4bb29c\""
Sep 16 13:44:01.507141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.507121    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"]
Sep 16 13:44:01.543165 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.543139    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"]
Sep 16 13:44:01.546521 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.546503    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.571811 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.571770    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"]
Sep 16 13:44:01.582602 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.582575    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnkvr\" (UniqueName: \"kubernetes.io/projected/edad014c-8817-41e0-b03b-b7462abc78b1-kube-api-access-tnkvr\") pod \"payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.582727 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.582618    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edad014c-8817-41e0-b03b-b7462abc78b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.684076 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.684034    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4b5k\" (UniqueName: \"kubernetes.io/projected/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-kube-api-access-r4b5k\") pod \"payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.684256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.684120    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.684256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.684175    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnkvr\" (UniqueName: \"kubernetes.io/projected/edad014c-8817-41e0-b03b-b7462abc78b1-kube-api-access-tnkvr\") pod \"payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.684256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.684211    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edad014c-8817-41e0-b03b-b7462abc78b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.685147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.685127    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edad014c-8817-41e0-b03b-b7462abc78b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.703159 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.703132    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnkvr\" (UniqueName: \"kubernetes.io/projected/edad014c-8817-41e0-b03b-b7462abc78b1-kube-api-access-tnkvr\") pod \"payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.785726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.785698    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4b5k\" (UniqueName: \"kubernetes.io/projected/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-kube-api-access-r4b5k\") pod \"payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.785866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.785745    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.786387 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.786369    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.790596 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.790574    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:01.801245 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.801221    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4b5k\" (UniqueName: \"kubernetes.io/projected/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-kube-api-access-r4b5k\") pod \"payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:01.864403 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:01.864376    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:02.093392 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.093366    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"]
Sep 16 13:44:02.094869 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:44:02.094841    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedad014c_8817_41e0_b03b_b7462abc78b1.slice/crio-535934362e5c58e0442ee266c8146276705def1e178dca7c733d4f673778471f WatchSource:0}: Error finding container 535934362e5c58e0442ee266c8146276705def1e178dca7c733d4f673778471f: Status 404 returned error can't find the container with id 535934362e5c58e0442ee266c8146276705def1e178dca7c733d4f673778471f
Sep 16 13:44:02.207705 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.207675    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"]
Sep 16 13:44:02.208950 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:44:02.208924    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebb33fb_fae7_4b13_80c8_b2b6e2f29962.slice/crio-44faf12ca3a59d9fa72d743ee9a589756008f953d7346e1357584e9ffeace104 WatchSource:0}: Error finding container 44faf12ca3a59d9fa72d743ee9a589756008f953d7346e1357584e9ffeace104: Status 404 returned error can't find the container with id 44faf12ca3a59d9fa72d743ee9a589756008f953d7346e1357584e9ffeace104
Sep 16 13:44:02.489609 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.489479    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f" event={"ID":"bebb33fb-fae7-4b13-80c8-b2b6e2f29962","Type":"ContainerStarted","Data":"f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e"}
Sep 16 13:44:02.489609 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.489555    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f" event={"ID":"bebb33fb-fae7-4b13-80c8-b2b6e2f29962","Type":"ContainerStarted","Data":"44faf12ca3a59d9fa72d743ee9a589756008f953d7346e1357584e9ffeace104"}
Sep 16 13:44:02.490101 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.489638    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:02.491700 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.491674    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8" event={"ID":"edad014c-8817-41e0-b03b-b7462abc78b1","Type":"ContainerStarted","Data":"da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44"}
Sep 16 13:44:02.491838 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.491716    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8" event={"ID":"edad014c-8817-41e0-b03b-b7462abc78b1","Type":"ContainerStarted","Data":"535934362e5c58e0442ee266c8146276705def1e178dca7c733d4f673778471f"}
Sep 16 13:44:02.491838 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.491743    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:02.552312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.552262    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f" podStartSLOduration=1.552242461 podStartE2EDuration="1.552242461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:02.550062268 +0000 UTC m=+787.303752391" watchObservedRunningTime="2026-09-16 13:44:02.552242461 +0000 UTC m=+787.305932585"
Sep 16 13:44:02.632301 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:02.632244    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8" podStartSLOduration=1.63222446 podStartE2EDuration="1.63222446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:02.629798732 +0000 UTC m=+787.383488854" watchObservedRunningTime="2026-09-16 13:44:02.63222446 +0000 UTC m=+787.385914587"
Sep 16 13:44:08.458462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:08.458434    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:44:09.471464 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:09.471436    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:44:11.484939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:11.484912    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:44:12.065815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.065770    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"]
Sep 16 13:44:12.070238 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.070216    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.082983 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.082799    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqztj\" (UniqueName: \"kubernetes.io/projected/76ca3c01-a774-4220-bee7-7a500e6f0983-kube-api-access-rqztj\") pod \"payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.082983 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.082932    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ca3c01-a774-4220-bee7-7a500e6f0983-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.083646 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.083364    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-14f2a6-dockercfg-pbb97\""
Sep 16 13:44:12.083646 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.083366    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-14f2a6\""
Sep 16 13:44:12.115567 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.115522    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"]
Sep 16 13:44:12.183788 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.183752    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ca3c01-a774-4220-bee7-7a500e6f0983-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.183953 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.183807    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqztj\" (UniqueName: \"kubernetes.io/projected/76ca3c01-a774-4220-bee7-7a500e6f0983-kube-api-access-rqztj\") pod \"payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.184815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.184794    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ca3c01-a774-4220-bee7-7a500e6f0983-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.257566 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.247973    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqztj\" (UniqueName: \"kubernetes.io/projected/76ca3c01-a774-4220-bee7-7a500e6f0983-kube-api-access-rqztj\") pod \"payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.389430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.389351    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:12.706293 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:12.706267    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"]
Sep 16 13:44:12.708340 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:44:12.708313    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ca3c01_a774_4220_bee7_7a500e6f0983.slice/crio-547740a0dfe216cb6c1815c0d7a49032bca5e1f43533aef2b62dbc8afcb5dc50 WatchSource:0}: Error finding container 547740a0dfe216cb6c1815c0d7a49032bca5e1f43533aef2b62dbc8afcb5dc50: Status 404 returned error can't find the container with id 547740a0dfe216cb6c1815c0d7a49032bca5e1f43533aef2b62dbc8afcb5dc50
Sep 16 13:44:13.498683 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:13.498652    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:44:13.498891 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:13.498723    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:44:13.591105 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:13.591071    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d" event={"ID":"76ca3c01-a774-4220-bee7-7a500e6f0983","Type":"ContainerStarted","Data":"83c2c3d14f0419c00a3b0b8431acd1a49076938fe5ff1be581287635c189a5c1"}
Sep 16 13:44:13.591281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:13.591129    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d" event={"ID":"76ca3c01-a774-4220-bee7-7a500e6f0983","Type":"ContainerStarted","Data":"547740a0dfe216cb6c1815c0d7a49032bca5e1f43533aef2b62dbc8afcb5dc50"}
Sep 16 13:44:13.591281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:13.591191    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:13.693713 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:13.693661    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d" podStartSLOduration=1.693640764 podStartE2EDuration="1.693640764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:13.693434973 +0000 UTC m=+798.447125107" watchObservedRunningTime="2026-09-16 13:44:13.693640764 +0000 UTC m=+798.447330886"
Sep 16 13:44:19.134109 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.134042    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"]
Sep 16 13:44:19.136582 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.136537    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.141412 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.141388    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4e1907f7\""
Sep 16 13:44:19.141718 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.141695    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4e1907f7-dockercfg-9cplb\""
Sep 16 13:44:19.146087 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.146059    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"]
Sep 16 13:44:19.149047 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.149030    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.160317 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.160298    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"]
Sep 16 13:44:19.168469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.168449    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"]
Sep 16 13:44:19.256373 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.256347    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e91a7ce-45aa-4d4f-85d1-700890de92ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.256531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.256411    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbsbw\" (UniqueName: \"kubernetes.io/projected/3e91a7ce-45aa-4d4f-85d1-700890de92ce-kube-api-access-mbsbw\") pod \"payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.256531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.256490    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p84r5\" (UniqueName: \"kubernetes.io/projected/6ffbda08-cb2f-4de9-a7ee-c19045d35747-kube-api-access-p84r5\") pod \"payload-processing-e2e-ait-4e1907f7-678787588f-6pl87\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") " pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.256531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.256510    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffbda08-cb2f-4de9-a7ee-c19045d35747-plugins-config-volume\") pod \"payload-processing-e2e-ait-4e1907f7-678787588f-6pl87\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") " pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.357385 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.357354    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p84r5\" (UniqueName: \"kubernetes.io/projected/6ffbda08-cb2f-4de9-a7ee-c19045d35747-kube-api-access-p84r5\") pod \"payload-processing-e2e-ait-4e1907f7-678787588f-6pl87\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") " pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.357524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.357391    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffbda08-cb2f-4de9-a7ee-c19045d35747-plugins-config-volume\") pod \"payload-processing-e2e-ait-4e1907f7-678787588f-6pl87\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") " pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.357524 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.357467    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e91a7ce-45aa-4d4f-85d1-700890de92ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.357655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.357561    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbsbw\" (UniqueName: \"kubernetes.io/projected/3e91a7ce-45aa-4d4f-85d1-700890de92ce-kube-api-access-mbsbw\") pod \"payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.358259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.358233    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffbda08-cb2f-4de9-a7ee-c19045d35747-plugins-config-volume\") pod \"payload-processing-e2e-ait-4e1907f7-678787588f-6pl87\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") " pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.358357 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.358280    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e91a7ce-45aa-4d4f-85d1-700890de92ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.384177 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.384150    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p84r5\" (UniqueName: \"kubernetes.io/projected/6ffbda08-cb2f-4de9-a7ee-c19045d35747-kube-api-access-p84r5\") pod \"payload-processing-e2e-ait-4e1907f7-678787588f-6pl87\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") " pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.386607 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.386584    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbsbw\" (UniqueName: \"kubernetes.io/projected/3e91a7ce-45aa-4d4f-85d1-700890de92ce-kube-api-access-mbsbw\") pod \"payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.447652 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.447628    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:19.460874 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.460854    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:19.628862 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.628833    2552 generic.go:356] "Generic (PLEG): container finished" podID="63816847-5ec3-4a5e-8475-09708f56c80d" containerID="e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f" exitCode=0
Sep 16 13:44:19.629029 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.628912    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" event={"ID":"63816847-5ec3-4a5e-8475-09708f56c80d","Type":"ContainerDied","Data":"e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"}
Sep 16 13:44:19.629311 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.629293    2552 scope.go:117] "RemoveContainer" containerID="e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"
Sep 16 13:44:19.630405 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.630380    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:44:19.630459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.630446    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:44:19.630494 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.630483    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:44:19.738298 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.738265    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"]
Sep 16 13:44:19.739096 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:44:19.739069    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffbda08_cb2f_4de9_a7ee_c19045d35747.slice/crio-dd899899d025d4d92730b042aad9b62360afd64b624db5efc9f909773b6120aa WatchSource:0}: Error finding container dd899899d025d4d92730b042aad9b62360afd64b624db5efc9f909773b6120aa: Status 404 returned error can't find the container with id dd899899d025d4d92730b042aad9b62360afd64b624db5efc9f909773b6120aa
Sep 16 13:44:19.758048 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:19.757985    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"]
Sep 16 13:44:19.761334 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:44:19.761290    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e91a7ce_45aa_4d4f_85d1_700890de92ce.slice/crio-7e3ffa33f3d3cc9db1a611cb1750d57e9a6736f87278398aa43f8503c1c14722 WatchSource:0}: Error finding container 7e3ffa33f3d3cc9db1a611cb1750d57e9a6736f87278398aa43f8503c1c14722: Status 404 returned error can't find the container with id 7e3ffa33f3d3cc9db1a611cb1750d57e9a6736f87278398aa43f8503c1c14722
Sep 16 13:44:20.636154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.636107    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87" event={"ID":"6ffbda08-cb2f-4de9-a7ee-c19045d35747","Type":"ContainerStarted","Data":"620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf"}
Sep 16 13:44:20.636657 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.636178    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:20.636657 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.636207    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87" event={"ID":"6ffbda08-cb2f-4de9-a7ee-c19045d35747","Type":"ContainerStarted","Data":"dd899899d025d4d92730b042aad9b62360afd64b624db5efc9f909773b6120aa"}
Sep 16 13:44:20.637780 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.637758    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl" event={"ID":"3e91a7ce-45aa-4d4f-85d1-700890de92ce","Type":"ContainerStarted","Data":"e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66"}
Sep 16 13:44:20.637893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.637805    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl" event={"ID":"3e91a7ce-45aa-4d4f-85d1-700890de92ce","Type":"ContainerStarted","Data":"7e3ffa33f3d3cc9db1a611cb1750d57e9a6736f87278398aa43f8503c1c14722"}
Sep 16 13:44:20.637893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.637835    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:20.639752 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.639733    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" event={"ID":"63816847-5ec3-4a5e-8475-09708f56c80d","Type":"ContainerStarted","Data":"b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723"}
Sep 16 13:44:20.665272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.665197    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87" podStartSLOduration=1.665118141 podStartE2EDuration="1.665118141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:20.662902812 +0000 UTC m=+805.416592935" watchObservedRunningTime="2026-09-16 13:44:20.665118141 +0000 UTC m=+805.418808263"
Sep 16 13:44:20.755239 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.755175    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl" podStartSLOduration=1.755139989 podStartE2EDuration="1.755139989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:20.693578401 +0000 UTC m=+805.447268520" watchObservedRunningTime="2026-09-16 13:44:20.755139989 +0000 UTC m=+805.508830115"
Sep 16 13:44:20.876564 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.875800    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:44:20.876564 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.876526    2552 patch_prober.go:28] interesting pod/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:44:20.876803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:20.876596    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:44:21.873106 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:21.873068    2552 patch_prober.go:28] interesting pod/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:44:21.873459 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:21.873126    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:44:22.872431 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:22.872396    2552 patch_prober.go:28] interesting pod/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:44:22.872616 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:22.872454    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:44:23.423876 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:23.423844    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:44:23.872845 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:23.872807    2552 patch_prober.go:28] interesting pod/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:44:23.873013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:23.872885    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:44:24.598520 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:24.598486    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:44:24.872903 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:24.872813    2552 patch_prober.go:28] interesting pod/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 16 13:44:24.872903 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:24.872873    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 16 13:44:25.001429 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.001394    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"]
Sep 16 13:44:25.009706 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.009680    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.013763 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.013742    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1e5db0-dockercfg-gpxql\""
Sep 16 13:44:25.014238 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.014218    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1e5db0\""
Sep 16 13:44:25.029835 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.029811    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"]
Sep 16 13:44:25.118095 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.118054    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741332d4-8dad-4c75-a9a6-83630dc538a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.118257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.118131    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbc8z\" (UniqueName: \"kubernetes.io/projected/741332d4-8dad-4c75-a9a6-83630dc538a0-kube-api-access-gbc8z\") pod \"payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.219940 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.219857    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741332d4-8dad-4c75-a9a6-83630dc538a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.219940 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.219913    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbc8z\" (UniqueName: \"kubernetes.io/projected/741332d4-8dad-4c75-a9a6-83630dc538a0-kube-api-access-gbc8z\") pod \"payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.220648 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.220624    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741332d4-8dad-4c75-a9a6-83630dc538a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.234537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.234511    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbc8z\" (UniqueName: \"kubernetes.io/projected/741332d4-8dad-4c75-a9a6-83630dc538a0-kube-api-access-gbc8z\") pod \"payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.321023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.320986    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:25.642322 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.642287    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"]
Sep 16 13:44:25.681492 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:25.681457    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz" event={"ID":"741332d4-8dad-4c75-a9a6-83630dc538a0","Type":"ContainerStarted","Data":"08f0d12e01fb8d92864ca67ed5d7ae4d035b6cf8714316f0441ca2fa78111452"}
Sep 16 13:44:26.102877 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:26.102846    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:44:26.103994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:26.103972    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:44:26.688678 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:26.688640    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz" event={"ID":"741332d4-8dad-4c75-a9a6-83630dc538a0","Type":"ContainerStarted","Data":"d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6"}
Sep 16 13:44:26.689049 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:26.688861    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:26.710918 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:26.710870    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz" podStartSLOduration=2.710855366 podStartE2EDuration="2.710855366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:26.709736336 +0000 UTC m=+811.463426456" watchObservedRunningTime="2026-09-16 13:44:26.710855366 +0000 UTC m=+811.464545488"
Sep 16 13:44:31.651366 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:31.651336    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:31.651778 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:31.651410    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:37.696345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:37.696313    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:44:51.080084 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.080045    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"]
Sep 16 13:44:51.080692 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.080304    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87" podUID="6ffbda08-cb2f-4de9-a7ee-c19045d35747" containerName="payload-processing" containerID="cri-o://620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf" gracePeriod=30
Sep 16 13:44:51.090758 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.090729    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"]
Sep 16 13:44:51.090987 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.090940    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl" podUID="3e91a7ce-45aa-4d4f-85d1-700890de92ce" containerName="payload-pre-processing" containerID="cri-o://e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66" gracePeriod=30
Sep 16 13:44:51.360466 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.360442    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:51.365691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.365667    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffbda08-cb2f-4de9-a7ee-c19045d35747-plugins-config-volume\") pod \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") "
Sep 16 13:44:51.365827 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.365733    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p84r5\" (UniqueName: \"kubernetes.io/projected/6ffbda08-cb2f-4de9-a7ee-c19045d35747-kube-api-access-p84r5\") pod \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\" (UID: \"6ffbda08-cb2f-4de9-a7ee-c19045d35747\") "
Sep 16 13:44:51.366187 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.366079    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ffbda08-cb2f-4de9-a7ee-c19045d35747-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ffbda08-cb2f-4de9-a7ee-c19045d35747" (UID: "6ffbda08-cb2f-4de9-a7ee-c19045d35747"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:44:51.368024 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.368000    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ffbda08-cb2f-4de9-a7ee-c19045d35747-kube-api-access-p84r5" (OuterVolumeSpecName: "kube-api-access-p84r5") pod "6ffbda08-cb2f-4de9-a7ee-c19045d35747" (UID: "6ffbda08-cb2f-4de9-a7ee-c19045d35747"). InnerVolumeSpecName "kube-api-access-p84r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:44:51.387434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.387339    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:51.466925 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.466895    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbsbw\" (UniqueName: \"kubernetes.io/projected/3e91a7ce-45aa-4d4f-85d1-700890de92ce-kube-api-access-mbsbw\") pod \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") "
Sep 16 13:44:51.467130 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.467117    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p84r5\" (UniqueName: \"kubernetes.io/projected/6ffbda08-cb2f-4de9-a7ee-c19045d35747-kube-api-access-p84r5\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:44:51.467195 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.467132    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ffbda08-cb2f-4de9-a7ee-c19045d35747-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:44:51.469404 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.469360    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e91a7ce-45aa-4d4f-85d1-700890de92ce-kube-api-access-mbsbw" (OuterVolumeSpecName: "kube-api-access-mbsbw") pod "3e91a7ce-45aa-4d4f-85d1-700890de92ce" (UID: "3e91a7ce-45aa-4d4f-85d1-700890de92ce"). InnerVolumeSpecName "kube-api-access-mbsbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:44:51.567585 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.567525    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e91a7ce-45aa-4d4f-85d1-700890de92ce-plugins-config-volume\") pod \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\" (UID: \"3e91a7ce-45aa-4d4f-85d1-700890de92ce\") "
Sep 16 13:44:51.567786 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.567772    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbsbw\" (UniqueName: \"kubernetes.io/projected/3e91a7ce-45aa-4d4f-85d1-700890de92ce-kube-api-access-mbsbw\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:44:51.567895 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.567872    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e91a7ce-45aa-4d4f-85d1-700890de92ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e91a7ce-45aa-4d4f-85d1-700890de92ce" (UID: "3e91a7ce-45aa-4d4f-85d1-700890de92ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:44:51.668756 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.668686    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e91a7ce-45aa-4d4f-85d1-700890de92ce-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:44:51.835604 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.835564    2552 generic.go:356] "Generic (PLEG): container finished" podID="6ffbda08-cb2f-4de9-a7ee-c19045d35747" containerID="620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf" exitCode=0
Sep 16 13:44:51.835792 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.835614    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"
Sep 16 13:44:51.837068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.837039    2552 generic.go:356] "Generic (PLEG): container finished" podID="3e91a7ce-45aa-4d4f-85d1-700890de92ce" containerID="e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66" exitCode=0
Sep 16 13:44:51.837208 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.837144    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"
Sep 16 13:44:51.839371 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.839342    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87" event={"ID":"6ffbda08-cb2f-4de9-a7ee-c19045d35747","Type":"ContainerDied","Data":"620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf"}
Sep 16 13:44:51.839493 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.839396    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87" event={"ID":"6ffbda08-cb2f-4de9-a7ee-c19045d35747","Type":"ContainerDied","Data":"dd899899d025d4d92730b042aad9b62360afd64b624db5efc9f909773b6120aa"}
Sep 16 13:44:51.839493 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.839421    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl" event={"ID":"3e91a7ce-45aa-4d4f-85d1-700890de92ce","Type":"ContainerDied","Data":"e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66"}
Sep 16 13:44:51.839493 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.839444    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl" event={"ID":"3e91a7ce-45aa-4d4f-85d1-700890de92ce","Type":"ContainerDied","Data":"7e3ffa33f3d3cc9db1a611cb1750d57e9a6736f87278398aa43f8503c1c14722"}
Sep 16 13:44:51.839677 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.839471    2552 scope.go:117] "RemoveContainer" containerID="620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf"
Sep 16 13:44:51.852018 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.851996    2552 scope.go:117] "RemoveContainer" containerID="620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf"
Sep 16 13:44:51.852323 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:44:51.852276    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf\": container with ID starting with 620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf not found: ID does not exist" containerID="620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf"
Sep 16 13:44:51.852416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.852316    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf"} err="failed to get container status \"620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf\": rpc error: code = NotFound desc = could not find container \"620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf\": container with ID starting with 620eb5cb295efd486a6755ec9dea05f98ae68721ce8c48a7dd28b8be4d8eefaf not found: ID does not exist"
Sep 16 13:44:51.852416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.852341    2552 scope.go:117] "RemoveContainer" containerID="e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66"
Sep 16 13:44:51.863268 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.863249    2552 scope.go:117] "RemoveContainer" containerID="e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66"
Sep 16 13:44:51.863590 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:44:51.863536    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66\": container with ID starting with e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66 not found: ID does not exist" containerID="e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66"
Sep 16 13:44:51.863656 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.863601    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66"} err="failed to get container status \"e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66\": rpc error: code = NotFound desc = could not find container \"e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66\": container with ID starting with e8a0925354c4780a5dac3ee88dc25c44c5a8dd4ec27cbceab274ffad13fd7c66 not found: ID does not exist"
Sep 16 13:44:51.867925 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.867901    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"]
Sep 16 13:44:51.870293 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.870272    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4e1907f7-678787588f-6pl87"]
Sep 16 13:44:51.887113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.887087    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"]
Sep 16 13:44:51.889358 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:51.889338    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4e1907f7-59d6b994f4-6bpbl"]
Sep 16 13:44:52.683001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.682968    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"]
Sep 16 13:44:52.683391 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.683378    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e91a7ce-45aa-4d4f-85d1-700890de92ce" containerName="payload-pre-processing"
Sep 16 13:44:52.683391 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.683392    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e91a7ce-45aa-4d4f-85d1-700890de92ce" containerName="payload-pre-processing"
Sep 16 13:44:52.683465 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.683420    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ffbda08-cb2f-4de9-a7ee-c19045d35747" containerName="payload-processing"
Sep 16 13:44:52.683465 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.683427    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ffbda08-cb2f-4de9-a7ee-c19045d35747" containerName="payload-processing"
Sep 16 13:44:52.683522 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.683483    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ffbda08-cb2f-4de9-a7ee-c19045d35747" containerName="payload-processing"
Sep 16 13:44:52.683522 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.683491    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e91a7ce-45aa-4d4f-85d1-700890de92ce" containerName="payload-pre-processing"
Sep 16 13:44:52.688056 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.688037    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.691463 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.691446    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6d94e3f8-gw-openshift-default-dockercfg-scqwd\""
Sep 16 13:44:52.719737 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.719707    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"]
Sep 16 13:44:52.777969 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.777936    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-certs\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.777976    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-podinfo\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.777997    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-socket\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.778052    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-credential-socket\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778151 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.778138    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4a826b2-efaf-4e54-8d68-368aa5325e10-istiod-ca-cert\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778344 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.778163    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-token\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778344 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.778193    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbkw\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-kube-api-access-zlbkw\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778344 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.778213    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-data\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.778344 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.778290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-envoy\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879053    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-certs\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879093    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-podinfo\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879124    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-socket\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879155    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-credential-socket\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879209    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4a826b2-efaf-4e54-8d68-368aa5325e10-istiod-ca-cert\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879236    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-token\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879509 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879267    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbkw\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-kube-api-access-zlbkw\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879509 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879296    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-data\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879509 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879336    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-envoy\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879555    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-socket\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879641    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-credential-socket\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879774    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-data\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879874 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879851    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-certs\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.879948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.879932    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4a826b2-efaf-4e54-8d68-368aa5325e10-istiod-ca-cert\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.881481 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.881453    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-envoy\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.881625 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.881526    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-podinfo\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.890469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.890447    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbkw\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-kube-api-access-zlbkw\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.894077 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.894058    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-token\") pod \"e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") " pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:52.998209 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:52.998132    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:53.283186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.283163    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"]
Sep 16 13:44:53.285201 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:44:53.285173    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a826b2_efaf_4e54_8d68_368aa5325e10.slice/crio-f0bfdf6de0cee5c830ffbd76051a7e2532d3f36df567686859652f730ac26038 WatchSource:0}: Error finding container f0bfdf6de0cee5c830ffbd76051a7e2532d3f36df567686859652f730ac26038: Status 404 returned error can't find the container with id f0bfdf6de0cee5c830ffbd76051a7e2532d3f36df567686859652f730ac26038
Sep 16 13:44:53.287342 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.287317    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:44:53.287399 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.287373    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:44:53.287434 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.287398    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:44:53.838426 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.838396    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e91a7ce-45aa-4d4f-85d1-700890de92ce" path="/var/lib/kubelet/pods/3e91a7ce-45aa-4d4f-85d1-700890de92ce/volumes"
Sep 16 13:44:53.838809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.838777    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ffbda08-cb2f-4de9-a7ee-c19045d35747" path="/var/lib/kubelet/pods/6ffbda08-cb2f-4de9-a7ee-c19045d35747/volumes"
Sep 16 13:44:53.850306 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.850276    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" event={"ID":"a4a826b2-efaf-4e54-8d68-368aa5325e10","Type":"ContainerStarted","Data":"6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"}
Sep 16 13:44:53.850463 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.850319    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" event={"ID":"a4a826b2-efaf-4e54-8d68-368aa5325e10","Type":"ContainerStarted","Data":"f0bfdf6de0cee5c830ffbd76051a7e2532d3f36df567686859652f730ac26038"}
Sep 16 13:44:53.877899 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.877854    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podStartSLOduration=1.877841179 podStartE2EDuration="1.877841179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:44:53.87428332 +0000 UTC m=+838.627973441" watchObservedRunningTime="2026-09-16 13:44:53.877841179 +0000 UTC m=+838.631531363"
Sep 16 13:44:53.998725 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:53.998694    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:55.003344 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:55.003312    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:55.860979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:55.860955    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:44:55.861892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:44:55.861874    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:00.182822 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.182788    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"]
Sep 16 13:45:00.188065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.188044    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"
Sep 16 13:45:00.199294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.199277    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:45:00.208090 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.208073    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"
Sep 16 13:45:00.220124 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.220102    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"]
Sep 16 13:45:00.225577 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.225556    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"]
Sep 16 13:45:00.230056 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.230035    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"
Sep 16 13:45:00.253165 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.252060    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"]
Sep 16 13:45:00.253937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.253755    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"
Sep 16 13:45:00.260164 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.260073    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"]
Sep 16 13:45:00.264294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.264273    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"
Sep 16 13:45:00.270341 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.270317    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"]
Sep 16 13:45:00.305955 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.305913    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"
Sep 16 13:45:00.495812 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.495786    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"]
Sep 16 13:45:00.498471 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:45:00.498449    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728ddd16_f145_4eb4_a6f1_05d16cca416b.slice/crio-b64a94cf824acd0614eee554275725b5d4b57c25da40bbbb01cf9744d351865e WatchSource:0}: Error finding container b64a94cf824acd0614eee554275725b5d4b57c25da40bbbb01cf9744d351865e: Status 404 returned error can't find the container with id b64a94cf824acd0614eee554275725b5d4b57c25da40bbbb01cf9744d351865e
Sep 16 13:45:00.554013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.553986    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"]
Sep 16 13:45:00.555585 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:45:00.555535    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9aa371_a48a_438f_aa81_b68c7deab9a4.slice/crio-27dd10bc5a85667f121f8677a0dd17c099630c87919aeeb6428fafcf86c7c52b WatchSource:0}: Error finding container 27dd10bc5a85667f121f8677a0dd17c099630c87919aeeb6428fafcf86c7c52b: Status 404 returned error can't find the container with id 27dd10bc5a85667f121f8677a0dd17c099630c87919aeeb6428fafcf86c7c52b
Sep 16 13:45:00.591961 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.591941    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"]
Sep 16 13:45:00.593454 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:45:00.593429    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e59baba_8585_43f1_87d6_022acfb831ba.slice/crio-dc2579383ed60472ecef79fffa0aff1d5203a280a47a5515970107a29f519073 WatchSource:0}: Error finding container dc2579383ed60472ecef79fffa0aff1d5203a280a47a5515970107a29f519073: Status 404 returned error can't find the container with id dc2579383ed60472ecef79fffa0aff1d5203a280a47a5515970107a29f519073
Sep 16 13:45:00.894188 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.894157    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs" event={"ID":"9e59baba-8585-43f1-87d6-022acfb831ba","Type":"ContainerStarted","Data":"dc2579383ed60472ecef79fffa0aff1d5203a280a47a5515970107a29f519073"}
Sep 16 13:45:00.895432 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.895406    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j" event={"ID":"728ddd16-f145-4eb4-a6f1-05d16cca416b","Type":"ContainerStarted","Data":"b64a94cf824acd0614eee554275725b5d4b57c25da40bbbb01cf9744d351865e"}
Sep 16 13:45:00.896646 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:00.896623    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw" event={"ID":"9a9aa371-a48a-438f-aa81-b68c7deab9a4","Type":"ContainerStarted","Data":"27dd10bc5a85667f121f8677a0dd17c099630c87919aeeb6428fafcf86c7c52b"}
Sep 16 13:45:03.920985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:03.920941    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs" event={"ID":"9e59baba-8585-43f1-87d6-022acfb831ba","Type":"ContainerStarted","Data":"047de300fb513f0a5f89cdd7513d82121526ea1be68b7168c7f97adb31b94d72"}
Sep 16 13:45:03.922514 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:03.922462    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j" event={"ID":"728ddd16-f145-4eb4-a6f1-05d16cca416b","Type":"ContainerStarted","Data":"0123d726d51d89a0f61b6203ad0e113568844644c73ce702fd5d2d839dd4a155"}
Sep 16 13:45:03.924063 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:03.924031    2552 generic.go:356] "Generic (PLEG): container finished" podID="9a9aa371-a48a-438f-aa81-b68c7deab9a4" containerID="6c7fe1f6cd90dbf52df3907931761f9bfaff3a2356740c26b92403f9f1b8af32" exitCode=0
Sep 16 13:45:03.924196 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:03.924074    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw" event={"ID":"9a9aa371-a48a-438f-aa81-b68c7deab9a4","Type":"ContainerDied","Data":"6c7fe1f6cd90dbf52df3907931761f9bfaff3a2356740c26b92403f9f1b8af32"}
Sep 16 13:45:03.938191 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:03.938146    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs" podStartSLOduration=1.577656765 podStartE2EDuration="3.938132733s" totalImagesPullingTime="2.360475968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:03.936256179 +0000 UTC m=+848.689946301" watchObservedRunningTime="2026-09-16 13:45:03.938132733 +0000 UTC m=+848.691822845"
Sep 16 13:45:03.953765 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:03.953728    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j" podStartSLOduration=1.4922180649999999 podStartE2EDuration="3.953712973s" totalImagesPullingTime="2.461494908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:03.950944503 +0000 UTC m=+848.704634616" watchObservedRunningTime="2026-09-16 13:45:03.953712973 +0000 UTC m=+848.707403093"
Sep 16 13:45:04.930948 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:04.930908    2552 generic.go:356] "Generic (PLEG): container finished" podID="9e59baba-8585-43f1-87d6-022acfb831ba" containerID="047de300fb513f0a5f89cdd7513d82121526ea1be68b7168c7f97adb31b94d72" exitCode=0
Sep 16 13:45:04.931342 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:04.930987    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs" event={"ID":"9e59baba-8585-43f1-87d6-022acfb831ba","Type":"ContainerDied","Data":"047de300fb513f0a5f89cdd7513d82121526ea1be68b7168c7f97adb31b94d72"}
Sep 16 13:45:04.932464 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:04.932439    2552 generic.go:356] "Generic (PLEG): container finished" podID="728ddd16-f145-4eb4-a6f1-05d16cca416b" containerID="0123d726d51d89a0f61b6203ad0e113568844644c73ce702fd5d2d839dd4a155" exitCode=0
Sep 16 13:45:04.932592 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:04.932515    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j" event={"ID":"728ddd16-f145-4eb4-a6f1-05d16cca416b","Type":"ContainerDied","Data":"0123d726d51d89a0f61b6203ad0e113568844644c73ce702fd5d2d839dd4a155"}
Sep 16 13:45:05.077282 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:05.077258    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"
Sep 16 13:45:05.942408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:05.942376    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw" event={"ID":"9a9aa371-a48a-438f-aa81-b68c7deab9a4","Type":"ContainerDied","Data":"27dd10bc5a85667f121f8677a0dd17c099630c87919aeeb6428fafcf86c7c52b"}
Sep 16 13:45:05.942408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:05.942406    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"
Sep 16 13:45:05.942899 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:05.942431    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27dd10bc5a85667f121f8677a0dd17c099630c87919aeeb6428fafcf86c7c52b"
Sep 16 13:45:06.109466 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.109439    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"
Sep 16 13:45:06.112286 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.112268    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"
Sep 16 13:45:06.949202 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.949173    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"
Sep 16 13:45:06.949689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.949213    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs" event={"ID":"9e59baba-8585-43f1-87d6-022acfb831ba","Type":"ContainerDied","Data":"dc2579383ed60472ecef79fffa0aff1d5203a280a47a5515970107a29f519073"}
Sep 16 13:45:06.949689 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.949263    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc2579383ed60472ecef79fffa0aff1d5203a280a47a5515970107a29f519073"
Sep 16 13:45:06.950702 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.950676    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j"
Sep 16 13:45:06.950702 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.950693    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826105-7862j" event={"ID":"728ddd16-f145-4eb4-a6f1-05d16cca416b","Type":"ContainerDied","Data":"b64a94cf824acd0614eee554275725b5d4b57c25da40bbbb01cf9744d351865e"}
Sep 16 13:45:06.950886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:06.950726    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b64a94cf824acd0614eee554275725b5d4b57c25da40bbbb01cf9744d351865e"
Sep 16 13:45:17.008834 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:17.008803    2552 generic.go:356] "Generic (PLEG): container finished" podID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerID="6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38" exitCode=0
Sep 16 13:45:17.009203 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:17.008874    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" event={"ID":"a4a826b2-efaf-4e54-8d68-368aa5325e10","Type":"ContainerDied","Data":"6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"}
Sep 16 13:45:17.009249 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:17.009223    2552 scope.go:117] "RemoveContainer" containerID="6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"
Sep 16 13:45:17.010308 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:17.010283    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:45:17.010386 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:17.010373    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:45:17.010420 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:17.010407    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:45:18.016610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:18.016574    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" event={"ID":"a4a826b2-efaf-4e54-8d68-368aa5325e10","Type":"ContainerStarted","Data":"11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7"}
Sep 16 13:45:18.998658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:18.998622    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:18.998877 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:18.998855    2552 patch_prober.go:28] interesting pod/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 13:45:18.998957 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:18.998919    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 13:45:19.999466 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:19.999433    2552 patch_prober.go:28] interesting pod/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 13:45:19.999869 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:19.999487    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 13:45:20.999512 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:20.999468    2552 patch_prober.go:28] interesting pod/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 13:45:21.000013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:20.999530    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 13:45:21.998731 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:21.998691    2552 patch_prober.go:28] interesting pod/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 13:45:21.998950 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:21.998746    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 13:45:22.999065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:22.999028    2552 patch_prober.go:28] interesting pod/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 16 13:45:22.999533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:22.999084    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 16 13:45:24.024648 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:24.024602    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:24.025109 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:24.024957    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:24.026775 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:24.026741    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:28.529174 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:28.529143    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"]
Sep 16 13:45:28.529538 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:28.529366    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy" containerID="cri-o://11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7" gracePeriod=30
Sep 16 13:45:33.790390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.790327    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:33.886196 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886165    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-data\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886213    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-certs\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886238    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4a826b2-efaf-4e54-8d68-368aa5325e10-istiod-ca-cert\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886279    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-podinfo\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886325    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-token\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886377    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-envoy\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886411    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-credential-socket\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886456    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlbkw\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-kube-api-access-zlbkw\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886473    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:45:33.886610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886497    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:45:33.886610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886505    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-socket\") pod \"a4a826b2-efaf-4e54-8d68-368aa5325e10\" (UID: \"a4a826b2-efaf-4e54-8d68-368aa5325e10\") "
Sep 16 13:45:33.886918 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886716    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:45:33.886918 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886734    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:45:33.886918 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886777    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a826b2-efaf-4e54-8d68-368aa5325e10-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:45:33.887065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886960    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.887065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886980    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.887065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.886994    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.887065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.887007    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4a826b2-efaf-4e54-8d68-368aa5325e10-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.887065 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.887021    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.888521 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.888493    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:45:33.888746 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.888717    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:45:33.888988 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.888967    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:45:33.888988 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.888975    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-kube-api-access-zlbkw" (OuterVolumeSpecName: "kube-api-access-zlbkw") pod "a4a826b2-efaf-4e54-8d68-368aa5325e10" (UID: "a4a826b2-efaf-4e54-8d68-368aa5325e10"). InnerVolumeSpecName "kube-api-access-zlbkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:45:33.987866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.987847    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.987866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.987868    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.988013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.987877    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4a826b2-efaf-4e54-8d68-368aa5325e10-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:33.988013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:33.987886    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlbkw\" (UniqueName: \"kubernetes.io/projected/a4a826b2-efaf-4e54-8d68-368aa5325e10-kube-api-access-zlbkw\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:45:34.106878 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.106814    2552 generic.go:356] "Generic (PLEG): container finished" podID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerID="11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7" exitCode=0
Sep 16 13:45:34.106878 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.106873    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"
Sep 16 13:45:34.107071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.106910    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" event={"ID":"a4a826b2-efaf-4e54-8d68-368aa5325e10","Type":"ContainerDied","Data":"11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7"}
Sep 16 13:45:34.107071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.106970    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw" event={"ID":"a4a826b2-efaf-4e54-8d68-368aa5325e10","Type":"ContainerDied","Data":"f0bfdf6de0cee5c830ffbd76051a7e2532d3f36df567686859652f730ac26038"}
Sep 16 13:45:34.107071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.107001    2552 scope.go:117] "RemoveContainer" containerID="11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7"
Sep 16 13:45:34.120275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.120261    2552 scope.go:117] "RemoveContainer" containerID="6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"
Sep 16 13:45:34.128225 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.128210    2552 scope.go:117] "RemoveContainer" containerID="11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7"
Sep 16 13:45:34.128503 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:45:34.128477    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7\": container with ID starting with 11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7 not found: ID does not exist" containerID="11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7"
Sep 16 13:45:34.128582 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.128516    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7"} err="failed to get container status \"11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7\": rpc error: code = NotFound desc = could not find container \"11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7\": container with ID starting with 11b9113d4cbc05cd32c99d69aec0d3774fa733cf1f83f2eb168674fe0a69b3e7 not found: ID does not exist"
Sep 16 13:45:34.128582 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.128534    2552 scope.go:117] "RemoveContainer" containerID="6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"
Sep 16 13:45:34.128780 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:45:34.128763    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38\": container with ID starting with 6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38 not found: ID does not exist" containerID="6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"
Sep 16 13:45:34.128837 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.128785    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38"} err="failed to get container status \"6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38\": rpc error: code = NotFound desc = could not find container \"6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38\": container with ID starting with 6a506e6c2bd8e15d952ce807ec167a1018df734c455ee20f86e33be637653b38 not found: ID does not exist"
Sep 16 13:45:34.134999 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.134978    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"]
Sep 16 13:45:34.145255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:34.145233    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6d94e3f8-gw-openshift-default-6b9f7f8f7b-fp6qw"]
Sep 16 13:45:35.240408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240378    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"]
Sep 16 13:45:35.240840 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240826    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy"
Sep 16 13:45:35.240893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240842    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy"
Sep 16 13:45:35.240893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240858    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e59baba-8585-43f1-87d6-022acfb831ba" containerName="cleanup"
Sep 16 13:45:35.240893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240866    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e59baba-8585-43f1-87d6-022acfb831ba" containerName="cleanup"
Sep 16 13:45:35.240893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240877    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy"
Sep 16 13:45:35.240893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240884    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240898    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9aa371-a48a-438f-aa81-b68c7deab9a4" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240903    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9aa371-a48a-438f-aa81-b68c7deab9a4" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240911    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728ddd16-f145-4eb4-a6f1-05d16cca416b" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240916    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="728ddd16-f145-4eb4-a6f1-05d16cca416b" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240971    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9aa371-a48a-438f-aa81-b68c7deab9a4" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240978    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="728ddd16-f145-4eb4-a6f1-05d16cca416b" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240985    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e59baba-8585-43f1-87d6-022acfb831ba" containerName="cleanup"
Sep 16 13:45:35.241059 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.240992    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy"
Sep 16 13:45:35.246121 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.246104    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.249271 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.249252    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1a60997c\""
Sep 16 13:45:35.260150 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.260123    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"]
Sep 16 13:45:35.299720 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.299691    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e78dc-3b57-4cc6-9bab-fb694377dd3f-plugins-config-volume\") pod \"payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") " pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.299820 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.299753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcgk6\" (UniqueName: \"kubernetes.io/projected/063e78dc-3b57-4cc6-9bab-fb694377dd3f-kube-api-access-zcgk6\") pod \"payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") " pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.401489 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.401447    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e78dc-3b57-4cc6-9bab-fb694377dd3f-plugins-config-volume\") pod \"payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") " pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.401714 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.401553    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcgk6\" (UniqueName: \"kubernetes.io/projected/063e78dc-3b57-4cc6-9bab-fb694377dd3f-kube-api-access-zcgk6\") pod \"payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") " pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.402337 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.402313    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e78dc-3b57-4cc6-9bab-fb694377dd3f-plugins-config-volume\") pod \"payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") " pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.415001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.414979    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcgk6\" (UniqueName: \"kubernetes.io/projected/063e78dc-3b57-4cc6-9bab-fb694377dd3f-kube-api-access-zcgk6\") pod \"payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") " pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.558785 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.558755    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:35.838831 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.838753    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" path="/var/lib/kubelet/pods/a4a826b2-efaf-4e54-8d68-368aa5325e10/volumes"
Sep 16 13:45:35.851408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:35.851381    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"]
Sep 16 13:45:35.851900 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:45:35.851875    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063e78dc_3b57_4cc6_9bab_fb694377dd3f.slice/crio-121778abb78d96206d9e48e6622e14004a5c1d300fa94e75a1ee2b014d59f943 WatchSource:0}: Error finding container 121778abb78d96206d9e48e6622e14004a5c1d300fa94e75a1ee2b014d59f943: Status 404 returned error can't find the container with id 121778abb78d96206d9e48e6622e14004a5c1d300fa94e75a1ee2b014d59f943
Sep 16 13:45:36.121342 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:36.121254    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h" event={"ID":"063e78dc-3b57-4cc6-9bab-fb694377dd3f","Type":"ContainerStarted","Data":"0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9"}
Sep 16 13:45:36.121481 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:36.121342    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h" event={"ID":"063e78dc-3b57-4cc6-9bab-fb694377dd3f","Type":"ContainerStarted","Data":"121778abb78d96206d9e48e6622e14004a5c1d300fa94e75a1ee2b014d59f943"}
Sep 16 13:45:36.121481 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:36.121372    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:36.147942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:36.147890    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h" podStartSLOduration=1.147873027 podStartE2EDuration="1.147873027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:45:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:45:36.147017236 +0000 UTC m=+880.900707383" watchObservedRunningTime="2026-09-16 13:45:36.147873027 +0000 UTC m=+880.901563150"
Sep 16 13:45:47.129794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:47.129765    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:45:55.660413 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:55.660316    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:45:55.661095 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:45:55.661070    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:46:02.662913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.662879    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"]
Sep 16 13:46:02.663384 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.663372    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a826b2-efaf-4e54-8d68-368aa5325e10" containerName="istio-proxy"
Sep 16 13:46:02.666728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.666711    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:02.671118 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.671087    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:46:02.681115 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.681089    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"]
Sep 16 13:46:02.748324 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.748292    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0153b7-b701-4b2c-a566-576683bda5a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5\" (UID: \"2f0153b7-b701-4b2c-a566-576683bda5a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:02.848889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.848855    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0153b7-b701-4b2c-a566-576683bda5a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5\" (UID: \"2f0153b7-b701-4b2c-a566-576683bda5a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:02.849447 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.849427    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0153b7-b701-4b2c-a566-576683bda5a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5\" (UID: \"2f0153b7-b701-4b2c-a566-576683bda5a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:02.984964 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:02.984874    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:03.288488 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:03.288465    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"]
Sep 16 13:46:03.290469 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:46:03.290437    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0153b7_b701_4b2c_a566_576683bda5a7.slice/crio-c44210380add7a637c7fb1c0fad40d05cd0fcf5fe9914eea4833df79995e6236 WatchSource:0}: Error finding container c44210380add7a637c7fb1c0fad40d05cd0fcf5fe9914eea4833df79995e6236: Status 404 returned error can't find the container with id c44210380add7a637c7fb1c0fad40d05cd0fcf5fe9914eea4833df79995e6236
Sep 16 13:46:04.284892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:04.284855    2552 generic.go:356] "Generic (PLEG): container finished" podID="2f0153b7-b701-4b2c-a566-576683bda5a7" containerID="9a566d0dac6f1ee7fbd0316aed774b80dd264542e8c327a3d529a8d10c3bd105" exitCode=0
Sep 16 13:46:04.285255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:04.284938    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5" event={"ID":"2f0153b7-b701-4b2c-a566-576683bda5a7","Type":"ContainerDied","Data":"9a566d0dac6f1ee7fbd0316aed774b80dd264542e8c327a3d529a8d10c3bd105"}
Sep 16 13:46:04.285255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:04.284992    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5" event={"ID":"2f0153b7-b701-4b2c-a566-576683bda5a7","Type":"ContainerStarted","Data":"c44210380add7a637c7fb1c0fad40d05cd0fcf5fe9914eea4833df79995e6236"}
Sep 16 13:46:05.436124 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:05.436105    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:05.576089 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:05.576017    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0153b7-b701-4b2c-a566-576683bda5a7-maas-api-service-ca\") pod \"2f0153b7-b701-4b2c-a566-576683bda5a7\" (UID: \"2f0153b7-b701-4b2c-a566-576683bda5a7\") "
Sep 16 13:46:05.576398 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:05.576377    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0153b7-b701-4b2c-a566-576683bda5a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f0153b7-b701-4b2c-a566-576683bda5a7" (UID: "2f0153b7-b701-4b2c-a566-576683bda5a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:05.677521 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:05.677496    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0153b7-b701-4b2c-a566-576683bda5a7-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:06.296470 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:06.296444    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"
Sep 16 13:46:06.296651 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:06.296481    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5" event={"ID":"2f0153b7-b701-4b2c-a566-576683bda5a7","Type":"ContainerDied","Data":"c44210380add7a637c7fb1c0fad40d05cd0fcf5fe9914eea4833df79995e6236"}
Sep 16 13:46:06.296651 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:06.296525    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c44210380add7a637c7fb1c0fad40d05cd0fcf5fe9914eea4833df79995e6236"
Sep 16 13:46:13.508714 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.508681    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"]
Sep 16 13:46:13.509126 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.508928    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h" podUID="063e78dc-3b57-4cc6-9bab-fb694377dd3f" containerName="payload-processing" containerID="cri-o://0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9" gracePeriod=30
Sep 16 13:46:13.691861 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.691835    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"]
Sep 16 13:46:13.695578 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.695556    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1a60997c-vqvd5"]
Sep 16 13:46:13.775069 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.775046    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:46:13.839591 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.839533    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0153b7-b701-4b2c-a566-576683bda5a7" path="/var/lib/kubelet/pods/2f0153b7-b701-4b2c-a566-576683bda5a7/volumes"
Sep 16 13:46:13.854348 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.854168    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcgk6\" (UniqueName: \"kubernetes.io/projected/063e78dc-3b57-4cc6-9bab-fb694377dd3f-kube-api-access-zcgk6\") pod \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") "
Sep 16 13:46:13.854348 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.854246    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e78dc-3b57-4cc6-9bab-fb694377dd3f-plugins-config-volume\") pod \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\" (UID: \"063e78dc-3b57-4cc6-9bab-fb694377dd3f\") "
Sep 16 13:46:13.854891 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.854861    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/063e78dc-3b57-4cc6-9bab-fb694377dd3f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "063e78dc-3b57-4cc6-9bab-fb694377dd3f" (UID: "063e78dc-3b57-4cc6-9bab-fb694377dd3f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:13.856994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.856958    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063e78dc-3b57-4cc6-9bab-fb694377dd3f-kube-api-access-zcgk6" (OuterVolumeSpecName: "kube-api-access-zcgk6") pod "063e78dc-3b57-4cc6-9bab-fb694377dd3f" (UID: "063e78dc-3b57-4cc6-9bab-fb694377dd3f"). InnerVolumeSpecName "kube-api-access-zcgk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:13.955600 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.955571    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e78dc-3b57-4cc6-9bab-fb694377dd3f-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:13.955600 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:13.955596    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcgk6\" (UniqueName: \"kubernetes.io/projected/063e78dc-3b57-4cc6-9bab-fb694377dd3f-kube-api-access-zcgk6\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:14.343003 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.342968    2552 generic.go:356] "Generic (PLEG): container finished" podID="063e78dc-3b57-4cc6-9bab-fb694377dd3f" containerID="0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9" exitCode=0
Sep 16 13:46:14.343198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.343019    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"
Sep 16 13:46:14.343198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.343032    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h" event={"ID":"063e78dc-3b57-4cc6-9bab-fb694377dd3f","Type":"ContainerDied","Data":"0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9"}
Sep 16 13:46:14.343198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.343073    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h" event={"ID":"063e78dc-3b57-4cc6-9bab-fb694377dd3f","Type":"ContainerDied","Data":"121778abb78d96206d9e48e6622e14004a5c1d300fa94e75a1ee2b014d59f943"}
Sep 16 13:46:14.343198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.343098    2552 scope.go:117] "RemoveContainer" containerID="0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9"
Sep 16 13:46:14.361760 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.361732    2552 scope.go:117] "RemoveContainer" containerID="0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9"
Sep 16 13:46:14.362124 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:46:14.362094    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9\": container with ID starting with 0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9 not found: ID does not exist" containerID="0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9"
Sep 16 13:46:14.362245 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.362138    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9"} err="failed to get container status \"0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9\": rpc error: code = NotFound desc = could not find container \"0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9\": container with ID starting with 0c9e9f63ea56b4425e392fe3a5e1aa3db392efb2eb215ffc3b45b36a3f668ec9 not found: ID does not exist"
Sep 16 13:46:14.376254 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.376227    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"]
Sep 16 13:46:14.385881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:14.385862    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1a60997c-8c4dccfdc-2ls5h"]
Sep 16 13:46:15.838068 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.838041    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="063e78dc-3b57-4cc6-9bab-fb694377dd3f" path="/var/lib/kubelet/pods/063e78dc-3b57-4cc6-9bab-fb694377dd3f/volumes"
Sep 16 13:46:15.873405 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.873375    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"]
Sep 16 13:46:15.874031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.874005    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063e78dc-3b57-4cc6-9bab-fb694377dd3f" containerName="payload-processing"
Sep 16 13:46:15.874031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.874030    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="063e78dc-3b57-4cc6-9bab-fb694377dd3f" containerName="payload-processing"
Sep 16 13:46:15.874226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.874063    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0153b7-b701-4b2c-a566-576683bda5a7" containerName="revoke-keys"
Sep 16 13:46:15.874226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.874072    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0153b7-b701-4b2c-a566-576683bda5a7" containerName="revoke-keys"
Sep 16 13:46:15.874226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.874185    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0153b7-b701-4b2c-a566-576683bda5a7" containerName="revoke-keys"
Sep 16 13:46:15.874226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.874203    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="063e78dc-3b57-4cc6-9bab-fb694377dd3f" containerName="payload-processing"
Sep 16 13:46:15.878610 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.878587    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.882814 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.882783    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4985b031-openshift-default-dockercfg-bfbwc\""
Sep 16 13:46:15.892445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.892422    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"]
Sep 16 13:46:15.974842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.974806    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df415f81-c928-4c7c-a41a-08da14b0218e-istiod-ca-cert\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975046 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.974851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df415f81-c928-4c7c-a41a-08da14b0218e-istio-podinfo\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975046 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.974872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-envoy\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975046 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.974919    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-credential-socket\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975046 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.974982    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-socket\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975046 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.975029    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-istio-token\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975289 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.975057    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqh8k\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-kube-api-access-pqh8k\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975289 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.975108    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-certs\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:15.975289 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:15.975236    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-data\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.075913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.075884    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-data\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.075913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.075920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df415f81-c928-4c7c-a41a-08da14b0218e-istiod-ca-cert\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076153 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.075936    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df415f81-c928-4c7c-a41a-08da14b0218e-istio-podinfo\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076153 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076112    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-envoy\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076175    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-credential-socket\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076201    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-socket\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076237    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-istio-token\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076265    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqh8k\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-kube-api-access-pqh8k\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076491 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076314    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-certs\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076759 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076714    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df415f81-c928-4c7c-a41a-08da14b0218e-istiod-ca-cert\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076759 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076721    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-data\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076940 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076763    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-credential-socket\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.076940 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.076868    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-socket\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.077037 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.077017    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-certs\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.078732 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.078711    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-envoy\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.078832 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.078795    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df415f81-c928-4c7c-a41a-08da14b0218e-istio-podinfo\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.088752 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.088697    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-istio-token\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.088902 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.088883    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqh8k\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-kube-api-access-pqh8k\") pod \"e2e-derive-4985b031-openshift-default-56455484d8-nxkn5\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") " pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.190587 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.190533    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:16.471492 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.471468    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"]
Sep 16 13:46:16.473430 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:46:16.473401    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf415f81_c928_4c7c_a41a_08da14b0218e.slice/crio-ba8a2fe0c16df0ae7ecbd9a37a9a86b12807597303521a675e57fc5075a346af WatchSource:0}: Error finding container ba8a2fe0c16df0ae7ecbd9a37a9a86b12807597303521a675e57fc5075a346af: Status 404 returned error can't find the container with id ba8a2fe0c16df0ae7ecbd9a37a9a86b12807597303521a675e57fc5075a346af
Sep 16 13:46:16.475683 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.475652    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:46:16.475795 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.475715    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:46:16.475795 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:16.475742    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:46:17.361949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:17.361916    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" event={"ID":"df415f81-c928-4c7c-a41a-08da14b0218e","Type":"ContainerStarted","Data":"0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"}
Sep 16 13:46:17.362325 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:17.361964    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" event={"ID":"df415f81-c928-4c7c-a41a-08da14b0218e","Type":"ContainerStarted","Data":"ba8a2fe0c16df0ae7ecbd9a37a9a86b12807597303521a675e57fc5075a346af"}
Sep 16 13:46:17.392637 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:17.392591    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" podStartSLOduration=2.392576919 podStartE2EDuration="2.392576919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:46:17.391021377 +0000 UTC m=+922.144711501" watchObservedRunningTime="2026-09-16 13:46:17.392576919 +0000 UTC m=+922.146267037"
Sep 16 13:46:18.191154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:18.191123    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:18.196157 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:18.196131    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:18.366874 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:18.366848    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:18.367536 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:18.367519    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:24.257099 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.257063    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"]
Sep 16 13:46:24.270348 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.269747    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:24.274943 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.274902    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"]
Sep 16 13:46:24.276916 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.275513    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:46:24.354431 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.354394    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1ad1fb-60b5-409b-837c-4dc17d7483ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x\" (UID: \"3a1ad1fb-60b5-409b-837c-4dc17d7483ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:24.455174 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.455138    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1ad1fb-60b5-409b-837c-4dc17d7483ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x\" (UID: \"3a1ad1fb-60b5-409b-837c-4dc17d7483ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:24.455860 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.455836    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1ad1fb-60b5-409b-837c-4dc17d7483ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x\" (UID: \"3a1ad1fb-60b5-409b-837c-4dc17d7483ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:24.586565 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.586469    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:24.862507 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.862481    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"]
Sep 16 13:46:24.864241 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:46:24.864214    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1ad1fb_60b5_409b_837c_4dc17d7483ba.slice/crio-0f23c95da76bcb7bf526897dcdccfee701b7e1fbf56c22f3843c4a6e5a83921c WatchSource:0}: Error finding container 0f23c95da76bcb7bf526897dcdccfee701b7e1fbf56c22f3843c4a6e5a83921c: Status 404 returned error can't find the container with id 0f23c95da76bcb7bf526897dcdccfee701b7e1fbf56c22f3843c4a6e5a83921c
Sep 16 13:46:24.934101 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.934075    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"]
Sep 16 13:46:24.938783 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.938767    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:24.941929 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.941856    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-4985b031-dockercfg-bs6hs\""
Sep 16 13:46:24.941929 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.941885    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-4985b031\""
Sep 16 13:46:24.949670 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:24.949612    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"]
Sep 16 13:46:25.062134 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.062096    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9624fd-5171-4f3d-83ef-f7647e9894c1-plugins-config-volume\") pod \"payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") " pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.062288 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.062180    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smml\" (UniqueName: \"kubernetes.io/projected/cc9624fd-5171-4f3d-83ef-f7647e9894c1-kube-api-access-7smml\") pod \"payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") " pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.163072 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.163040    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smml\" (UniqueName: \"kubernetes.io/projected/cc9624fd-5171-4f3d-83ef-f7647e9894c1-kube-api-access-7smml\") pod \"payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") " pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.163188 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.163141    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9624fd-5171-4f3d-83ef-f7647e9894c1-plugins-config-volume\") pod \"payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") " pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.163824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.163805    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9624fd-5171-4f3d-83ef-f7647e9894c1-plugins-config-volume\") pod \"payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") " pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.171942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.171922    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smml\" (UniqueName: \"kubernetes.io/projected/cc9624fd-5171-4f3d-83ef-f7647e9894c1-kube-api-access-7smml\") pod \"payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") " pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.250622 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.250593    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:25.405968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.405883    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x" event={"ID":"3a1ad1fb-60b5-409b-837c-4dc17d7483ba","Type":"ContainerStarted","Data":"94e44331a0b72576ac9a38c93238a89c0216e388726bcedd6c02878e67022945"}
Sep 16 13:46:25.405968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.405933    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x" event={"ID":"3a1ad1fb-60b5-409b-837c-4dc17d7483ba","Type":"ContainerStarted","Data":"0f23c95da76bcb7bf526897dcdccfee701b7e1fbf56c22f3843c4a6e5a83921c"}
Sep 16 13:46:25.425678 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.425629    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x" podStartSLOduration=1.425612841 podStartE2EDuration="1.425612841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:46:25.424589919 +0000 UTC m=+930.178280048" watchObservedRunningTime="2026-09-16 13:46:25.425612841 +0000 UTC m=+930.179302963"
Sep 16 13:46:25.528992 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:25.528962    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"]
Sep 16 13:46:25.531195 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:46:25.531169    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9624fd_5171_4f3d_83ef_f7647e9894c1.slice/crio-c98e880bf0214b9ffb73e6c85a4bc3f3402e62b9e45c839b444465c3e792ad91 WatchSource:0}: Error finding container c98e880bf0214b9ffb73e6c85a4bc3f3402e62b9e45c839b444465c3e792ad91: Status 404 returned error can't find the container with id c98e880bf0214b9ffb73e6c85a4bc3f3402e62b9e45c839b444465c3e792ad91
Sep 16 13:46:26.413471 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:26.413434    2552 generic.go:356] "Generic (PLEG): container finished" podID="3a1ad1fb-60b5-409b-837c-4dc17d7483ba" containerID="94e44331a0b72576ac9a38c93238a89c0216e388726bcedd6c02878e67022945" exitCode=0
Sep 16 13:46:26.413942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:26.413516    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x" event={"ID":"3a1ad1fb-60b5-409b-837c-4dc17d7483ba","Type":"ContainerDied","Data":"94e44331a0b72576ac9a38c93238a89c0216e388726bcedd6c02878e67022945"}
Sep 16 13:46:26.415157 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:26.415135    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b" event={"ID":"cc9624fd-5171-4f3d-83ef-f7647e9894c1","Type":"ContainerStarted","Data":"4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa"}
Sep 16 13:46:26.415281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:26.415178    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:26.415281 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:26.415196    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b" event={"ID":"cc9624fd-5171-4f3d-83ef-f7647e9894c1","Type":"ContainerStarted","Data":"c98e880bf0214b9ffb73e6c85a4bc3f3402e62b9e45c839b444465c3e792ad91"}
Sep 16 13:46:26.470687 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:26.470633    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b" podStartSLOduration=2.470613331 podStartE2EDuration="2.470613331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:46:26.467174421 +0000 UTC m=+931.220864564" watchObservedRunningTime="2026-09-16 13:46:26.470613331 +0000 UTC m=+931.224303452"
Sep 16 13:46:27.565363 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:27.565339    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:27.688266 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:27.688177    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1ad1fb-60b5-409b-837c-4dc17d7483ba-maas-api-service-ca\") pod \"3a1ad1fb-60b5-409b-837c-4dc17d7483ba\" (UID: \"3a1ad1fb-60b5-409b-837c-4dc17d7483ba\") "
Sep 16 13:46:27.688525 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:27.688502    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1ad1fb-60b5-409b-837c-4dc17d7483ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a1ad1fb-60b5-409b-837c-4dc17d7483ba" (UID: "3a1ad1fb-60b5-409b-837c-4dc17d7483ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:27.789251 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:27.789222    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a1ad1fb-60b5-409b-837c-4dc17d7483ba-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:28.428080 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:28.428046    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"
Sep 16 13:46:28.428080 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:28.428064    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x" event={"ID":"3a1ad1fb-60b5-409b-837c-4dc17d7483ba","Type":"ContainerDied","Data":"0f23c95da76bcb7bf526897dcdccfee701b7e1fbf56c22f3843c4a6e5a83921c"}
Sep 16 13:46:28.428314 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:28.428191    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f23c95da76bcb7bf526897dcdccfee701b7e1fbf56c22f3843c4a6e5a83921c"
Sep 16 13:46:35.274826 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.274787    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"]
Sep 16 13:46:35.275362 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.275050    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d" podUID="76ca3c01-a774-4220-bee7-7a500e6f0983" containerName="payload-pre-processing" containerID="cri-o://83c2c3d14f0419c00a3b0b8431acd1a49076938fe5ff1be581287635c189a5c1" gracePeriod=30
Sep 16 13:46:35.475452 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.475218    2552 generic.go:356] "Generic (PLEG): container finished" podID="76ca3c01-a774-4220-bee7-7a500e6f0983" containerID="83c2c3d14f0419c00a3b0b8431acd1a49076938fe5ff1be581287635c189a5c1" exitCode=0
Sep 16 13:46:35.475452 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.475266    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d" event={"ID":"76ca3c01-a774-4220-bee7-7a500e6f0983","Type":"ContainerDied","Data":"83c2c3d14f0419c00a3b0b8431acd1a49076938fe5ff1be581287635c189a5c1"}
Sep 16 13:46:35.505640 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.505610    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"]
Sep 16 13:46:35.507826 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.507799    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-14f2a6-8fj5x"]
Sep 16 13:46:35.548282 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.548262    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:46:35.658294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.658258    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ca3c01-a774-4220-bee7-7a500e6f0983-plugins-config-volume\") pod \"76ca3c01-a774-4220-bee7-7a500e6f0983\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") "
Sep 16 13:46:35.658476 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.658309    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqztj\" (UniqueName: \"kubernetes.io/projected/76ca3c01-a774-4220-bee7-7a500e6f0983-kube-api-access-rqztj\") pod \"76ca3c01-a774-4220-bee7-7a500e6f0983\" (UID: \"76ca3c01-a774-4220-bee7-7a500e6f0983\") "
Sep 16 13:46:35.658742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.658715    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ca3c01-a774-4220-bee7-7a500e6f0983-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76ca3c01-a774-4220-bee7-7a500e6f0983" (UID: "76ca3c01-a774-4220-bee7-7a500e6f0983"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:35.660460 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.660436    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ca3c01-a774-4220-bee7-7a500e6f0983-kube-api-access-rqztj" (OuterVolumeSpecName: "kube-api-access-rqztj") pod "76ca3c01-a774-4220-bee7-7a500e6f0983" (UID: "76ca3c01-a774-4220-bee7-7a500e6f0983"). InnerVolumeSpecName "kube-api-access-rqztj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:35.759468 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.759437    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ca3c01-a774-4220-bee7-7a500e6f0983-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:35.759593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.759471    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqztj\" (UniqueName: \"kubernetes.io/projected/76ca3c01-a774-4220-bee7-7a500e6f0983-kube-api-access-rqztj\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:35.838237 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:35.838173    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a1ad1fb-60b5-409b-837c-4dc17d7483ba" path="/var/lib/kubelet/pods/3a1ad1fb-60b5-409b-837c-4dc17d7483ba/volumes"
Sep 16 13:46:36.482038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:36.481997    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d" event={"ID":"76ca3c01-a774-4220-bee7-7a500e6f0983","Type":"ContainerDied","Data":"547740a0dfe216cb6c1815c0d7a49032bca5e1f43533aef2b62dbc8afcb5dc50"}
Sep 16 13:46:36.482038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:36.482027    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"
Sep 16 13:46:36.482537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:36.482067    2552 scope.go:117] "RemoveContainer" containerID="83c2c3d14f0419c00a3b0b8431acd1a49076938fe5ff1be581287635c189a5c1"
Sep 16 13:46:36.512171 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:36.512140    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"]
Sep 16 13:46:36.527020 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:36.526995    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-14f2a6-6859c994c4-sp57d"]
Sep 16 13:46:37.423137 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:37.423106    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:37.838454 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:37.838424    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ca3c01-a774-4220-bee7-7a500e6f0983" path="/var/lib/kubelet/pods/76ca3c01-a774-4220-bee7-7a500e6f0983/volumes"
Sep 16 13:46:43.635937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.635896    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"]
Sep 16 13:46:43.636536 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.636514    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ca3c01-a774-4220-bee7-7a500e6f0983" containerName="payload-pre-processing"
Sep 16 13:46:43.636658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.636538    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ca3c01-a774-4220-bee7-7a500e6f0983" containerName="payload-pre-processing"
Sep 16 13:46:43.636658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.636572    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1ad1fb-60b5-409b-837c-4dc17d7483ba" containerName="revoke-keys"
Sep 16 13:46:43.636658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.636580    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1ad1fb-60b5-409b-837c-4dc17d7483ba" containerName="revoke-keys"
Sep 16 13:46:43.636817 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.636701    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a1ad1fb-60b5-409b-837c-4dc17d7483ba" containerName="revoke-keys"
Sep 16 13:46:43.636817 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.636717    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ca3c01-a774-4220-bee7-7a500e6f0983" containerName="payload-pre-processing"
Sep 16 13:46:43.641431 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.641408    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:43.647788 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.647759    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"]
Sep 16 13:46:43.648365 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.648339    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:46:43.731711 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.731675    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e086539-7948-4305-9ca1-4010a17d5775-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4985b031-8hsrx\" (UID: \"4e086539-7948-4305-9ca1-4010a17d5775\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:43.832843 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.832803    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e086539-7948-4305-9ca1-4010a17d5775-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4985b031-8hsrx\" (UID: \"4e086539-7948-4305-9ca1-4010a17d5775\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:43.833624 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.833602    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e086539-7948-4305-9ca1-4010a17d5775-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4985b031-8hsrx\" (UID: \"4e086539-7948-4305-9ca1-4010a17d5775\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:43.959627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:43.959511    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:44.242815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:44.242705    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"]
Sep 16 13:46:44.246344 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:46:44.246295    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e086539_7948_4305_9ca1_4010a17d5775.slice/crio-2e221e210d82290cfc0c2f53fe2a47dbeef1b34b7e1386a55a94a1842e43050c WatchSource:0}: Error finding container 2e221e210d82290cfc0c2f53fe2a47dbeef1b34b7e1386a55a94a1842e43050c: Status 404 returned error can't find the container with id 2e221e210d82290cfc0c2f53fe2a47dbeef1b34b7e1386a55a94a1842e43050c
Sep 16 13:46:44.530774 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:44.530744    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx" event={"ID":"4e086539-7948-4305-9ca1-4010a17d5775","Type":"ContainerStarted","Data":"2e221e210d82290cfc0c2f53fe2a47dbeef1b34b7e1386a55a94a1842e43050c"}
Sep 16 13:46:45.537660 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:45.537569    2552 generic.go:356] "Generic (PLEG): container finished" podID="4e086539-7948-4305-9ca1-4010a17d5775" containerID="95dd3b8ca11a509bf46bb989d1bc9856343714d4e5c7a419c950d45b26b709b5" exitCode=0
Sep 16 13:46:45.537660 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:45.537638    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx" event={"ID":"4e086539-7948-4305-9ca1-4010a17d5775","Type":"ContainerDied","Data":"95dd3b8ca11a509bf46bb989d1bc9856343714d4e5c7a419c950d45b26b709b5"}
Sep 16 13:46:46.706504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:46.706475    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:46.863253 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:46.863153    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e086539-7948-4305-9ca1-4010a17d5775-maas-api-service-ca\") pod \"4e086539-7948-4305-9ca1-4010a17d5775\" (UID: \"4e086539-7948-4305-9ca1-4010a17d5775\") "
Sep 16 13:46:46.863501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:46.863476    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e086539-7948-4305-9ca1-4010a17d5775-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e086539-7948-4305-9ca1-4010a17d5775" (UID: "4e086539-7948-4305-9ca1-4010a17d5775"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:46.863629 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:46.863615    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e086539-7948-4305-9ca1-4010a17d5775-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:47.552647 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:47.552614    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"
Sep 16 13:46:47.552809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:47.552613    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx" event={"ID":"4e086539-7948-4305-9ca1-4010a17d5775","Type":"ContainerDied","Data":"2e221e210d82290cfc0c2f53fe2a47dbeef1b34b7e1386a55a94a1842e43050c"}
Sep 16 13:46:47.552809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:47.552749    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e221e210d82290cfc0c2f53fe2a47dbeef1b34b7e1386a55a94a1842e43050c"
Sep 16 13:46:48.929130 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:48.928171    2552 patch_prober.go:28] interesting pod/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:34120->10.134.0.55:15021: read: connection reset by peer" start-of-body=
Sep 16 13:46:48.929130 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:48.928243    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:34120->10.134.0.55:15021: read: connection reset by peer"
Sep 16 13:46:49.566462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:49.566421    2552 generic.go:356] "Generic (PLEG): container finished" podID="df415f81-c928-4c7c-a41a-08da14b0218e" containerID="0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd" exitCode=0
Sep 16 13:46:49.566462 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:49.566456    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" event={"ID":"df415f81-c928-4c7c-a41a-08da14b0218e","Type":"ContainerDied","Data":"0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"}
Sep 16 13:46:49.566950 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:49.566932    2552 scope.go:117] "RemoveContainer" containerID="0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"
Sep 16 13:46:49.568107 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:49.568082    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:46:49.568164 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:49.568146    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:46:49.568199 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:49.568176    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:46:50.575340 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:50.575309    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" event={"ID":"df415f81-c928-4c7c-a41a-08da14b0218e","Type":"ContainerStarted","Data":"0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335"}
Sep 16 13:46:50.968142 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:50.968063    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"]
Sep 16 13:46:50.968328 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:50.968283    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b" podUID="cc9624fd-5171-4f3d-83ef-f7647e9894c1" containerName="payload-processing" containerID="cri-o://4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa" gracePeriod=30
Sep 16 13:46:51.167583 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.166680    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"]
Sep 16 13:46:51.170257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.170230    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4985b031-8hsrx"]
Sep 16 13:46:51.191052 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.191028    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:51.191437 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.191394    2552 patch_prober.go:28] interesting pod/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 13:46:51.191600 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.191443    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 13:46:51.239715 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.239693    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:51.366658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.366629    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"]
Sep 16 13:46:51.413263 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.413234    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smml\" (UniqueName: \"kubernetes.io/projected/cc9624fd-5171-4f3d-83ef-f7647e9894c1-kube-api-access-7smml\") pod \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") "
Sep 16 13:46:51.413433 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.413350    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9624fd-5171-4f3d-83ef-f7647e9894c1-plugins-config-volume\") pod \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\" (UID: \"cc9624fd-5171-4f3d-83ef-f7647e9894c1\") "
Sep 16 13:46:51.413766 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.413745    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc9624fd-5171-4f3d-83ef-f7647e9894c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc9624fd-5171-4f3d-83ef-f7647e9894c1" (UID: "cc9624fd-5171-4f3d-83ef-f7647e9894c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:51.415278 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.415256    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9624fd-5171-4f3d-83ef-f7647e9894c1-kube-api-access-7smml" (OuterVolumeSpecName: "kube-api-access-7smml") pod "cc9624fd-5171-4f3d-83ef-f7647e9894c1" (UID: "cc9624fd-5171-4f3d-83ef-f7647e9894c1"). InnerVolumeSpecName "kube-api-access-7smml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:51.514476 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.514444    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9624fd-5171-4f3d-83ef-f7647e9894c1-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:51.514476 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.514470    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smml\" (UniqueName: \"kubernetes.io/projected/cc9624fd-5171-4f3d-83ef-f7647e9894c1-kube-api-access-7smml\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:51.582204 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.582173    2552 generic.go:356] "Generic (PLEG): container finished" podID="cc9624fd-5171-4f3d-83ef-f7647e9894c1" containerID="4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa" exitCode=0
Sep 16 13:46:51.582638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.582221    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"
Sep 16 13:46:51.582638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.582253    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b" event={"ID":"cc9624fd-5171-4f3d-83ef-f7647e9894c1","Type":"ContainerDied","Data":"4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa"}
Sep 16 13:46:51.582638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.582308    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b" event={"ID":"cc9624fd-5171-4f3d-83ef-f7647e9894c1","Type":"ContainerDied","Data":"c98e880bf0214b9ffb73e6c85a4bc3f3402e62b9e45c839b444465c3e792ad91"}
Sep 16 13:46:51.582638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.582330    2552 scope.go:117] "RemoveContainer" containerID="4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa"
Sep 16 13:46:51.582864 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.582765    2552 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" secret="" err="secret \"e2e-derive-4985b031-openshift-default-dockercfg-bfbwc\" not found"
Sep 16 13:46:51.591779 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.591754    2552 scope.go:117] "RemoveContainer" containerID="4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa"
Sep 16 13:46:51.592059 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:46:51.592040    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa\": container with ID starting with 4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa not found: ID does not exist" containerID="4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa"
Sep 16 13:46:51.592156 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.592067    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa"} err="failed to get container status \"4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa\": rpc error: code = NotFound desc = could not find container \"4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa\": container with ID starting with 4cae162304f5c091c0b69d7e75e4fb772c2ab2cb83a79dfa29bc01d21d1045aa not found: ID does not exist"
Sep 16 13:46:51.606514 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.606494    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"]
Sep 16 13:46:51.610470 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.610447    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-4985b031-6c99c746b5-gfp4b"]
Sep 16 13:46:51.838665 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.838583    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e086539-7948-4305-9ca1-4010a17d5775" path="/var/lib/kubelet/pods/4e086539-7948-4305-9ca1-4010a17d5775/volumes"
Sep 16 13:46:51.838962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:51.838948    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9624fd-5171-4f3d-83ef-f7647e9894c1" path="/var/lib/kubelet/pods/cc9624fd-5171-4f3d-83ef-f7647e9894c1/volumes"
Sep 16 13:46:52.194916 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:52.194850    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:52.590001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:52.589968    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy" containerID="cri-o://0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335" gracePeriod=30
Sep 16 13:46:52.590447 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:52.590080    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:52.590935 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:52.590916    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:57.850081 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.850024    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.873783    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqh8k\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-kube-api-access-pqh8k\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.873888    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-socket\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.873946    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-data\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.874037    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df415f81-c928-4c7c-a41a-08da14b0218e-istio-podinfo\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.874063    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-istio-token\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.874121    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-credential-socket\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.874202    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df415f81-c928-4c7c-a41a-08da14b0218e-istiod-ca-cert\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.874239    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-certs\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.874580 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.874272    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-envoy\") pod \"df415f81-c928-4c7c-a41a-08da14b0218e\" (UID: \"df415f81-c928-4c7c-a41a-08da14b0218e\") "
Sep 16 13:46:57.877243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.876575    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:57.877243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.876925    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-data" (OuterVolumeSpecName: "istio-data") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:57.877243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.877131    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:57.877776 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.877755    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df415f81-c928-4c7c-a41a-08da14b0218e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:46:57.878160 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.878122    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-kube-api-access-pqh8k" (OuterVolumeSpecName: "kube-api-access-pqh8k") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "kube-api-access-pqh8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:57.878278 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.878258    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:57.885363 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.883458    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-istio-token" (OuterVolumeSpecName: "istio-token") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:46:57.887854 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.887813    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:46:57.887994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.887970    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df415f81-c928-4c7c-a41a-08da14b0218e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df415f81-c928-4c7c-a41a-08da14b0218e" (UID: "df415f81-c928-4c7c-a41a-08da14b0218e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:46:57.977508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977482    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977507    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqh8k\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-kube-api-access-pqh8k\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977517    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977525    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977534    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df415f81-c928-4c7c-a41a-08da14b0218e-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977560    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df415f81-c928-4c7c-a41a-08da14b0218e-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977569    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977577    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df415f81-c928-4c7c-a41a-08da14b0218e-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:57.977675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:57.977585    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df415f81-c928-4c7c-a41a-08da14b0218e-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:46:58.624318 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.624282    2552 generic.go:356] "Generic (PLEG): container finished" podID="df415f81-c928-4c7c-a41a-08da14b0218e" containerID="0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335" exitCode=0
Sep 16 13:46:58.624487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.624348    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"
Sep 16 13:46:58.624487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.624373    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" event={"ID":"df415f81-c928-4c7c-a41a-08da14b0218e","Type":"ContainerDied","Data":"0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335"}
Sep 16 13:46:58.624487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.624453    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5" event={"ID":"df415f81-c928-4c7c-a41a-08da14b0218e","Type":"ContainerDied","Data":"ba8a2fe0c16df0ae7ecbd9a37a9a86b12807597303521a675e57fc5075a346af"}
Sep 16 13:46:58.624487 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.624477    2552 scope.go:117] "RemoveContainer" containerID="0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335"
Sep 16 13:46:58.633472 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.633453    2552 scope.go:117] "RemoveContainer" containerID="0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"
Sep 16 13:46:58.641363 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.641345    2552 scope.go:117] "RemoveContainer" containerID="0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335"
Sep 16 13:46:58.641681 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:46:58.641663    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335\": container with ID starting with 0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335 not found: ID does not exist" containerID="0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335"
Sep 16 13:46:58.641769 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.641691    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335"} err="failed to get container status \"0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335\": rpc error: code = NotFound desc = could not find container \"0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335\": container with ID starting with 0c22eff2b3577b5473836103165ff178471707c4c207310770e52631d8f55335 not found: ID does not exist"
Sep 16 13:46:58.641769 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.641713    2552 scope.go:117] "RemoveContainer" containerID="0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"
Sep 16 13:46:58.641972 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:46:58.641956    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd\": container with ID starting with 0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd not found: ID does not exist" containerID="0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"
Sep 16 13:46:58.642025 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.641981    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd"} err="failed to get container status \"0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd\": rpc error: code = NotFound desc = could not find container \"0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd\": container with ID starting with 0621776938bdba42592589ef3dc8bfdeeffdfed6961991f64d55be19c445b0cd not found: ID does not exist"
Sep 16 13:46:58.648075 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.648056    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"]
Sep 16 13:46:58.650465 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:58.650440    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4985b031-openshift-default-56455484d8-nxkn5"]
Sep 16 13:46:59.838344 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:46:59.838310    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" path="/var/lib/kubelet/pods/df415f81-c928-4c7c-a41a-08da14b0218e/volumes"
Sep 16 13:47:02.043008 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.042969    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"]
Sep 16 13:47:02.043480 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043463    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy"
Sep 16 13:47:02.043576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043482    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy"
Sep 16 13:47:02.043576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043526    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e086539-7948-4305-9ca1-4010a17d5775" containerName="revoke-keys"
Sep 16 13:47:02.043576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043535    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e086539-7948-4305-9ca1-4010a17d5775" containerName="revoke-keys"
Sep 16 13:47:02.043740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043576    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9624fd-5171-4f3d-83ef-f7647e9894c1" containerName="payload-processing"
Sep 16 13:47:02.043740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043586    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9624fd-5171-4f3d-83ef-f7647e9894c1" containerName="payload-processing"
Sep 16 13:47:02.043740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043685    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9624fd-5171-4f3d-83ef-f7647e9894c1" containerName="payload-processing"
Sep 16 13:47:02.043740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043695    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy"
Sep 16 13:47:02.043740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.043703    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e086539-7948-4305-9ca1-4010a17d5775" containerName="revoke-keys"
Sep 16 13:47:02.053012 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.052992    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.056192 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.056168    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-4678b2-openshift-default-dockercfg-mdhpd\""
Sep 16 13:47:02.059882 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.059861    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"]
Sep 16 13:47:02.112614 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112583    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-credential-socket\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112733 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112630    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-envoy\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112733 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112664    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-podinfo\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112733 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112695    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-certs\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112733 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112711    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psl8m\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-kube-api-access-psl8m\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112765    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istiod-ca-cert\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112794    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-data\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112835    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-socket\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.112913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.112853    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-token\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214176 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214146    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-data\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214340 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214206    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-socket\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214340 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214238    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-token\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214340 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214308    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-credential-socket\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214340    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-envoy\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214385    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-podinfo\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214436    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-certs\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214461    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psl8m\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-kube-api-access-psl8m\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214492    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istiod-ca-cert\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214604    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-data\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214694    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-socket\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214859 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214811    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-credential-socket\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.214982 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.214960    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-certs\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.215162 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.215140    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istiod-ca-cert\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.216493 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.216460    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-envoy\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.216723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.216703    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-podinfo\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.223821 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.223799    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-token\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.223922 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.223900    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psl8m\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-kube-api-access-psl8m\") pod \"e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") " pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.366191 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.366128    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:02.658474 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:47:02.658445    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a449ab_a7ec_4931_a6b2_48c0fca7ab94.slice/crio-1c32770e0c0ed095569772752c9e410cee53c006088b978b9c918d0c724210a9 WatchSource:0}: Error finding container 1c32770e0c0ed095569772752c9e410cee53c006088b978b9c918d0c724210a9: Status 404 returned error can't find the container with id 1c32770e0c0ed095569772752c9e410cee53c006088b978b9c918d0c724210a9
Sep 16 13:47:02.660009 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.659979    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"]
Sep 16 13:47:02.660907 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.660868    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:47:02.660997 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.660960    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:47:02.661038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:02.661001    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:47:03.653853 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:03.653816    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" event={"ID":"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94","Type":"ContainerStarted","Data":"28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"}
Sep 16 13:47:03.654312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:03.653868    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" event={"ID":"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94","Type":"ContainerStarted","Data":"1c32770e0c0ed095569772752c9e410cee53c006088b978b9c918d0c724210a9"}
Sep 16 13:47:03.678217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:03.678169    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podStartSLOduration=1.678155516 podStartE2EDuration="1.678155516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:47:03.676564723 +0000 UTC m=+968.430254839" watchObservedRunningTime="2026-09-16 13:47:03.678155516 +0000 UTC m=+968.431845636"
Sep 16 13:47:04.366718 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:04.366685    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:04.371751 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:04.371726    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:04.660239 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:04.660152    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:04.661979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:04.661952    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:29.810633 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:29.810597    2552 generic.go:356] "Generic (PLEG): container finished" podID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerID="28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198" exitCode=0
Sep 16 13:47:29.811102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:29.810668    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" event={"ID":"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94","Type":"ContainerDied","Data":"28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"}
Sep 16 13:47:29.811102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:29.811078    2552 scope.go:117] "RemoveContainer" containerID="28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"
Sep 16 13:47:29.812163 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:29.812138    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:47:29.812219 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:29.812203    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:47:29.812256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:29.812235    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:47:30.820866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:30.820832    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" event={"ID":"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94","Type":"ContainerStarted","Data":"f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423"}
Sep 16 13:47:31.366796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:31.366766    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:31.368269 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:31.368244    2552 patch_prober.go:28] interesting pod/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 13:47:31.368460 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:31.368437    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 13:47:32.366869 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:32.366833    2552 patch_prober.go:28] interesting pod/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 13:47:32.367291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:32.366894    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 13:47:33.367359 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:33.367325    2552 patch_prober.go:28] interesting pod/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 13:47:33.367869 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:33.367383    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 13:47:34.367519 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:34.367469    2552 patch_prober.go:28] interesting pod/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 13:47:34.368056 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:34.367560    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 13:47:34.660855 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:34.660752    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:35.367500 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:35.367445    2552 patch_prober.go:28] interesting pod/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 13:47:35.367710 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:35.367527    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 13:47:36.366631 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:36.366588    2552 patch_prober.go:28] interesting pod/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 16 13:47:36.366805 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:36.366662    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 16 13:47:37.370676 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:37.370647    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:47:37.371638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:47:37.371619    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:48:28.548822 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.548788    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"]
Sep 16 13:48:28.549437 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.549418    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy"
Sep 16 13:48:28.549519 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.549441    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy"
Sep 16 13:48:28.549623 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.549610    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="df415f81-c928-4c7c-a41a-08da14b0218e" containerName="istio-proxy"
Sep 16 13:48:28.552692 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.552671    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.555604 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.555583    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ab3aa7c0-openshift-default-dockercfg-l9nb4\""
Sep 16 13:48:28.569071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.569047    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"]
Sep 16 13:48:28.602275 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602243    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-data\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602402 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602315    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-envoy\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602402 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602357    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-podinfo\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nst66\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-kube-api-access-nst66\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602448    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-socket\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602476    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-token\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602493    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istiod-ca-cert\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602697 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602530    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-certs\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.602697 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.602607    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-credential-socket\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703451    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-certs\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703495    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-credential-socket\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703516    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-data\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703585    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-envoy\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-podinfo\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703680    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nst66\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-kube-api-access-nst66\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703704    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-socket\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.703726 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703727    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-token\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.704026 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703745    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istiod-ca-cert\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.704026 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703892    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-certs\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.704026 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.703931    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-credential-socket\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.704186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.704042    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-data\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.704186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.704104    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-socket\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.704563 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.704530    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istiod-ca-cert\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.706219 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.706197    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-envoy\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.706415 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.706398    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-podinfo\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.713851 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.713823    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-token\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.714040 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.714017    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nst66\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-kube-api-access-nst66\") pod \"e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") " pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:28.864877 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:28.864790    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:29.140640 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:29.140615    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"]
Sep 16 13:48:29.142094 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:48:29.142064    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8aeebf_b7ed_49b8_b28e_9a23be9f2993.slice/crio-2c4500fd72d8aed2c50415169f008e74228e3410194839dc4421b8e4d292a947 WatchSource:0}: Error finding container 2c4500fd72d8aed2c50415169f008e74228e3410194839dc4421b8e4d292a947: Status 404 returned error can't find the container with id 2c4500fd72d8aed2c50415169f008e74228e3410194839dc4421b8e4d292a947
Sep 16 13:48:29.144470 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:29.144440    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:48:29.144590 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:29.144519    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:48:29.144590 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:29.144573    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:48:29.151092 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:29.151058    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" event={"ID":"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993","Type":"ContainerStarted","Data":"2c4500fd72d8aed2c50415169f008e74228e3410194839dc4421b8e4d292a947"}
Sep 16 13:48:30.164161 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:30.164125    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" event={"ID":"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993","Type":"ContainerStarted","Data":"df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"}
Sep 16 13:48:30.190664 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:30.190609    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podStartSLOduration=2.190594941 podStartE2EDuration="2.190594941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:48:30.188169728 +0000 UTC m=+1054.941859877" watchObservedRunningTime="2026-09-16 13:48:30.190594941 +0000 UTC m=+1054.944285062"
Sep 16 13:48:30.865589 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:30.865540    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:30.870880 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:30.870853    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:31.170532 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:31.170455    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:31.171415 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:31.171392    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:48:36.992468 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:36.992431    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"]
Sep 16 13:48:36.995303 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:36.995281    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:36.998864 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:36.998848    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ab3aa7c0\""
Sep 16 13:48:37.010480 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.010459    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"]
Sep 16 13:48:37.090303 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.090275    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8njq\" (UniqueName: \"kubernetes.io/projected/0187fa3c-7e66-4275-961b-634fba9de4b1-kube-api-access-h8njq\") pod \"payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.090483 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.090463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0187fa3c-7e66-4275-961b-634fba9de4b1-plugins-config-volume\") pod \"payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.191569 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.191525    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0187fa3c-7e66-4275-961b-634fba9de4b1-plugins-config-volume\") pod \"payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.191755 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.191592    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8njq\" (UniqueName: \"kubernetes.io/projected/0187fa3c-7e66-4275-961b-634fba9de4b1-kube-api-access-h8njq\") pod \"payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.193491 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.192899    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0187fa3c-7e66-4275-961b-634fba9de4b1-plugins-config-volume\") pod \"payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.203083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.203051    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8njq\" (UniqueName: \"kubernetes.io/projected/0187fa3c-7e66-4275-961b-634fba9de4b1-kube-api-access-h8njq\") pod \"payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.306140 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.306105    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:37.604181 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:37.604150    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"]
Sep 16 13:48:37.604305 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:48:37.604283    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0187fa3c_7e66_4275_961b_634fba9de4b1.slice/crio-1a01952cfdff9f40cf115aa19f3928aa9d328c803cbd2e1c7dc42adf2f474c2d WatchSource:0}: Error finding container 1a01952cfdff9f40cf115aa19f3928aa9d328c803cbd2e1c7dc42adf2f474c2d: Status 404 returned error can't find the container with id 1a01952cfdff9f40cf115aa19f3928aa9d328c803cbd2e1c7dc42adf2f474c2d
Sep 16 13:48:38.212842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:38.212800    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs" event={"ID":"0187fa3c-7e66-4275-961b-634fba9de4b1","Type":"ContainerStarted","Data":"81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b"}
Sep 16 13:48:38.213270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:38.212864    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs" event={"ID":"0187fa3c-7e66-4275-961b-634fba9de4b1","Type":"ContainerStarted","Data":"1a01952cfdff9f40cf115aa19f3928aa9d328c803cbd2e1c7dc42adf2f474c2d"}
Sep 16 13:48:38.213270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:38.212913    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:48:38.234673 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:38.234628    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs" podStartSLOduration=2.234613692 podStartE2EDuration="2.234613692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:48:38.232676333 +0000 UTC m=+1062.986366457" watchObservedRunningTime="2026-09-16 13:48:38.234613692 +0000 UTC m=+1062.988303813"
Sep 16 13:48:49.220296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:48:49.220214    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:49:05.392320 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:05.392287    2552 generic.go:356] "Generic (PLEG): container finished" podID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerID="df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f" exitCode=0
Sep 16 13:49:05.392728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:05.392362    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" event={"ID":"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993","Type":"ContainerDied","Data":"df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"}
Sep 16 13:49:05.392780 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:05.392760    2552 scope.go:117] "RemoveContainer" containerID="df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"
Sep 16 13:49:05.393882 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:05.393857    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:05.393953 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:05.393924    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:05.393997 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:05.393968    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:06.399183 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:06.399146    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" event={"ID":"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993","Type":"ContainerStarted","Data":"73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262"}
Sep 16 13:49:06.866291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:06.866142    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:49:06.866984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:06.866622    2552 patch_prober.go:28] interesting pod/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:49:06.866984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:06.866680    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:49:07.865613 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:07.865571    2552 patch_prober.go:28] interesting pod/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:49:07.866082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:07.865631    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:49:08.865504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:08.865468    2552 patch_prober.go:28] interesting pod/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:49:08.865806 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:08.865775    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:49:09.865810 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.865768    2552 patch_prober.go:28] interesting pod/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:49:09.866195 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.865837    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:49:09.959425 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.959385    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"]
Sep 16 13:49:09.964146 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.964120    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:09.970498 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.970465    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"]
Sep 16 13:49:09.970959 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.970936    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:49:09.999196 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:09.999169    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a776421-52f7-4c5e-af8a-a41ac57060dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh\" (UID: \"5a776421-52f7-4c5e-af8a-a41ac57060dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:10.100262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:10.100232    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a776421-52f7-4c5e-af8a-a41ac57060dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh\" (UID: \"5a776421-52f7-4c5e-af8a-a41ac57060dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:10.100859 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:10.100836    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a776421-52f7-4c5e-af8a-a41ac57060dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh\" (UID: \"5a776421-52f7-4c5e-af8a-a41ac57060dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:10.281455 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:10.281424    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:10.593508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:10.593484    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"]
Sep 16 13:49:10.595406 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:49:10.595365    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a776421_52f7_4c5e_af8a_a41ac57060dd.slice/crio-295260cd066823915bf13af72ae58c1382c456871188752084bdae0382b6e49d WatchSource:0}: Error finding container 295260cd066823915bf13af72ae58c1382c456871188752084bdae0382b6e49d: Status 404 returned error can't find the container with id 295260cd066823915bf13af72ae58c1382c456871188752084bdae0382b6e49d
Sep 16 13:49:10.865237 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:10.865200    2552 patch_prober.go:28] interesting pod/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:49:10.865389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:10.865286    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:49:11.430159 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:11.430110    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh" event={"ID":"5a776421-52f7-4c5e-af8a-a41ac57060dd","Type":"ContainerStarted","Data":"66c9bfff0bc20b9605cab9b961ee7286425e155981e0f33b4efb4db0673791bc"}
Sep 16 13:49:11.430525 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:11.430179    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh" event={"ID":"5a776421-52f7-4c5e-af8a-a41ac57060dd","Type":"ContainerStarted","Data":"295260cd066823915bf13af72ae58c1382c456871188752084bdae0382b6e49d"}
Sep 16 13:49:11.457328 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:11.457263    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh" podStartSLOduration=2.457239802 podStartE2EDuration="2.457239802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:49:11.45501886 +0000 UTC m=+1096.208708982" watchObservedRunningTime="2026-09-16 13:49:11.457239802 +0000 UTC m=+1096.210929924"
Sep 16 13:49:11.867037 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:11.866995    2552 patch_prober.go:28] interesting pod/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 13:49:11.867228 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:11.867060    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 13:49:12.437501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:12.437464    2552 generic.go:356] "Generic (PLEG): container finished" podID="5a776421-52f7-4c5e-af8a-a41ac57060dd" containerID="66c9bfff0bc20b9605cab9b961ee7286425e155981e0f33b4efb4db0673791bc" exitCode=0
Sep 16 13:49:12.437911 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:12.437531    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh" event={"ID":"5a776421-52f7-4c5e-af8a-a41ac57060dd","Type":"ContainerDied","Data":"66c9bfff0bc20b9605cab9b961ee7286425e155981e0f33b4efb4db0673791bc"}
Sep 16 13:49:12.869379 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:12.869346    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:49:12.869597 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:12.869576    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:49:12.870245 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:12.870228    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:49:13.587427 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:13.587397    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:13.640456 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:13.640422    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a776421-52f7-4c5e-af8a-a41ac57060dd-maas-api-service-ca\") pod \"5a776421-52f7-4c5e-af8a-a41ac57060dd\" (UID: \"5a776421-52f7-4c5e-af8a-a41ac57060dd\") "
Sep 16 13:49:13.640866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:13.640839    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a776421-52f7-4c5e-af8a-a41ac57060dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a776421-52f7-4c5e-af8a-a41ac57060dd" (UID: "5a776421-52f7-4c5e-af8a-a41ac57060dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:49:13.741613 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:13.741515    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a776421-52f7-4c5e-af8a-a41ac57060dd-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:14.458985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:14.458957    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"
Sep 16 13:49:14.459154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:14.459030    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh" event={"ID":"5a776421-52f7-4c5e-af8a-a41ac57060dd","Type":"ContainerDied","Data":"295260cd066823915bf13af72ae58c1382c456871188752084bdae0382b6e49d"}
Sep 16 13:49:14.459154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:14.459090    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="295260cd066823915bf13af72ae58c1382c456871188752084bdae0382b6e49d"
Sep 16 13:49:20.724444 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:20.724411    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"]
Sep 16 13:49:20.724893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:20.724692    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs" podUID="0187fa3c-7e66-4275-961b-634fba9de4b1" containerName="payload-processing" containerID="cri-o://81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b" gracePeriod=30
Sep 16 13:49:20.906397 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:20.906367    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"]
Sep 16 13:49:20.913655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:20.913624    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ab3aa7c0-4l5rh"]
Sep 16 13:49:21.000717 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.000695    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:49:21.111330 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.111299    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0187fa3c-7e66-4275-961b-634fba9de4b1-plugins-config-volume\") pod \"0187fa3c-7e66-4275-961b-634fba9de4b1\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") "
Sep 16 13:49:21.111529 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.111354    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8njq\" (UniqueName: \"kubernetes.io/projected/0187fa3c-7e66-4275-961b-634fba9de4b1-kube-api-access-h8njq\") pod \"0187fa3c-7e66-4275-961b-634fba9de4b1\" (UID: \"0187fa3c-7e66-4275-961b-634fba9de4b1\") "
Sep 16 13:49:21.111735 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.111708    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0187fa3c-7e66-4275-961b-634fba9de4b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0187fa3c-7e66-4275-961b-634fba9de4b1" (UID: "0187fa3c-7e66-4275-961b-634fba9de4b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:49:21.111824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.111810    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0187fa3c-7e66-4275-961b-634fba9de4b1-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:21.113482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.113459    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0187fa3c-7e66-4275-961b-634fba9de4b1-kube-api-access-h8njq" (OuterVolumeSpecName: "kube-api-access-h8njq") pod "0187fa3c-7e66-4275-961b-634fba9de4b1" (UID: "0187fa3c-7e66-4275-961b-634fba9de4b1"). InnerVolumeSpecName "kube-api-access-h8njq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:49:21.212975 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.212900    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8njq\" (UniqueName: \"kubernetes.io/projected/0187fa3c-7e66-4275-961b-634fba9de4b1-kube-api-access-h8njq\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:21.499947 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.499909    2552 generic.go:356] "Generic (PLEG): container finished" podID="0187fa3c-7e66-4275-961b-634fba9de4b1" containerID="81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b" exitCode=0
Sep 16 13:49:21.499947 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.499947    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"
Sep 16 13:49:21.500147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.500032    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs" event={"ID":"0187fa3c-7e66-4275-961b-634fba9de4b1","Type":"ContainerDied","Data":"81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b"}
Sep 16 13:49:21.500147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.500081    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs" event={"ID":"0187fa3c-7e66-4275-961b-634fba9de4b1","Type":"ContainerDied","Data":"1a01952cfdff9f40cf115aa19f3928aa9d328c803cbd2e1c7dc42adf2f474c2d"}
Sep 16 13:49:21.500147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.500103    2552 scope.go:117] "RemoveContainer" containerID="81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b"
Sep 16 13:49:21.509293 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.509275    2552 scope.go:117] "RemoveContainer" containerID="81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b"
Sep 16 13:49:21.509568 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:49:21.509531    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b\": container with ID starting with 81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b not found: ID does not exist" containerID="81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b"
Sep 16 13:49:21.509639 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.509579    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b"} err="failed to get container status \"81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b\": rpc error: code = NotFound desc = could not find container \"81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b\": container with ID starting with 81aa1845b6a82494ceaea03b2c1763b203ba67270cc5775a821f3aecc74d871b not found: ID does not exist"
Sep 16 13:49:21.525017 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.524995    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"]
Sep 16 13:49:21.527224 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.527202    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab3aa7c0-7bd6564c4f-j56rs"]
Sep 16 13:49:21.837707 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.837675    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0187fa3c-7e66-4275-961b-634fba9de4b1" path="/var/lib/kubelet/pods/0187fa3c-7e66-4275-961b-634fba9de4b1/volumes"
Sep 16 13:49:21.838082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:21.838015    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a776421-52f7-4c5e-af8a-a41ac57060dd" path="/var/lib/kubelet/pods/5a776421-52f7-4c5e-af8a-a41ac57060dd/volumes"
Sep 16 13:49:27.952406 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:27.952374    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"]
Sep 16 13:49:27.952871 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:27.952613    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy" containerID="cri-o://73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262" gracePeriod=30
Sep 16 13:49:29.577576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:29.577518    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"]
Sep 16 13:49:29.578031 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:29.577722    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy" containerID="cri-o://f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423" gracePeriod=30
Sep 16 13:49:30.332303 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332259    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"]
Sep 16 13:49:30.332848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332827    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0187fa3c-7e66-4275-961b-634fba9de4b1" containerName="payload-processing"
Sep 16 13:49:30.332848 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332849    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0187fa3c-7e66-4275-961b-634fba9de4b1" containerName="payload-processing"
Sep 16 13:49:30.333034 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332879    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a776421-52f7-4c5e-af8a-a41ac57060dd" containerName="revoke-keys"
Sep 16 13:49:30.333034 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332887    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a776421-52f7-4c5e-af8a-a41ac57060dd" containerName="revoke-keys"
Sep 16 13:49:30.333034 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332986    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0187fa3c-7e66-4275-961b-634fba9de4b1" containerName="payload-processing"
Sep 16 13:49:30.333034 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.332999    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a776421-52f7-4c5e-af8a-a41ac57060dd" containerName="revoke-keys"
Sep 16 13:49:30.336231 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.336211    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.339147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.339127    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-2b6ce0-openshift-default-dockercfg-mfvwm\""
Sep 16 13:49:30.348589 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.348567    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"]
Sep 16 13:49:30.500123 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500092    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c434304-078d-4620-b702-ac937e79efcf-istiod-ca-cert\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500143    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-data\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500196    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-socket\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500268    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-credential-socket\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500305    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-istio-token\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500356    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d8f\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-kube-api-access-l8d8f\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500420    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c434304-078d-4620-b702-ac937e79efcf-istio-podinfo\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500441    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-envoy\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.500485 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.500471    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-certs\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.601537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601442    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-socket\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.601537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601477    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-credential-socket\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.601537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601499    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-istio-token\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601538    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d8f\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-kube-api-access-l8d8f\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601615    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c434304-078d-4620-b702-ac937e79efcf-istio-podinfo\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601643    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-envoy\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601684    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-certs\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601731    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c434304-078d-4620-b702-ac937e79efcf-istiod-ca-cert\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601787    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-data\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601918    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-socket\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.601931    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-credential-socket\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602113 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.602101    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-data\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602619 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.602153    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-certs\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.602681 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.602618    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c434304-078d-4620-b702-ac937e79efcf-istiod-ca-cert\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.603969 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.603950    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-envoy\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.604038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.604001    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c434304-078d-4620-b702-ac937e79efcf-istio-podinfo\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.609285 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.609253    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d8f\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-kube-api-access-l8d8f\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.609625 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.609308    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-istio-token\") pod \"e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") " pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.649057 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.649032    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:30.927582 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.927534    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"]
Sep 16 13:49:30.928577 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:49:30.928524    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c434304_078d_4620_b702_ac937e79efcf.slice/crio-380050d1e682f77718273125e88bce908da285c7985c50b2aa45bd638a2e8391 WatchSource:0}: Error finding container 380050d1e682f77718273125e88bce908da285c7985c50b2aa45bd638a2e8391: Status 404 returned error can't find the container with id 380050d1e682f77718273125e88bce908da285c7985c50b2aa45bd638a2e8391
Sep 16 13:49:30.930943 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.930909    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:30.931038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.930986    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:30.931038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:30.931027    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:31.576190 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:31.576151    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf" event={"ID":"2c434304-078d-4620-b702-ac937e79efcf","Type":"ContainerStarted","Data":"24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0"}
Sep 16 13:49:31.576361 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:31.576218    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf" event={"ID":"2c434304-078d-4620-b702-ac937e79efcf","Type":"ContainerStarted","Data":"380050d1e682f77718273125e88bce908da285c7985c50b2aa45bd638a2e8391"}
Sep 16 13:49:31.601451 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:31.601392    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf" podStartSLOduration=1.601372553 podStartE2EDuration="1.601372553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:49:31.600858876 +0000 UTC m=+1116.354549018" watchObservedRunningTime="2026-09-16 13:49:31.601372553 +0000 UTC m=+1116.355062674"
Sep 16 13:49:31.649232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:31.649199    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:31.655082 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:31.655054    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:32.586884 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:32.586855    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:32.587755 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:32.587737    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:49:33.206130 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.206103    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:49:33.331694 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331673    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nst66\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-kube-api-access-nst66\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.331859 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331706    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-token\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.331859 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331735    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-envoy\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.331859 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331755    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-data\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.331859 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331816    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istiod-ca-cert\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.332083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331859    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-podinfo\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.332083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331897    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-socket\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.332083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331930    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-certs\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.332083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331969    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-credential-socket\") pod \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\" (UID: \"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993\") "
Sep 16 13:49:33.332083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.331981    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:33.332424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332174    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:33.332424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332185    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:33.332424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332369    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:33.332424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332399    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.332424 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332418    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.332727 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332431    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.332727 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.332530    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:49:33.333982 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.333956    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-kube-api-access-nst66" (OuterVolumeSpecName: "kube-api-access-nst66") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "kube-api-access-nst66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:49:33.333982 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.333966    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:33.334160 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.333963    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:49:33.334160 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.334130    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" (UID: "0b8aeebf-b7ed-49b8-b28e-9a23be9f2993"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:49:33.432937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.432911    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nst66\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-kube-api-access-nst66\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.432937 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.432934    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.433074 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.432947    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.433074 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.432958    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.433074 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.432969    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.433074 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.432980    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:33.595537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.595457    2552 generic.go:356] "Generic (PLEG): container finished" podID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerID="73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262" exitCode=0
Sep 16 13:49:33.595537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.595510    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"
Sep 16 13:49:33.595723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.595557    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" event={"ID":"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993","Type":"ContainerDied","Data":"73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262"}
Sep 16 13:49:33.595723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.595612    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2" event={"ID":"0b8aeebf-b7ed-49b8-b28e-9a23be9f2993","Type":"ContainerDied","Data":"2c4500fd72d8aed2c50415169f008e74228e3410194839dc4421b8e4d292a947"}
Sep 16 13:49:33.595723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.595644    2552 scope.go:117] "RemoveContainer" containerID="73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262"
Sep 16 13:49:33.605333 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.605317    2552 scope.go:117] "RemoveContainer" containerID="df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"
Sep 16 13:49:33.613801 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.613786    2552 scope.go:117] "RemoveContainer" containerID="73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262"
Sep 16 13:49:33.614049 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:49:33.614032    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262\": container with ID starting with 73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262 not found: ID does not exist" containerID="73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262"
Sep 16 13:49:33.614097 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.614058    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262"} err="failed to get container status \"73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262\": rpc error: code = NotFound desc = could not find container \"73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262\": container with ID starting with 73c7b2998bc4367dc1f04e06973d5e5d8590681bdb884a88c1e43b5cd0fa6262 not found: ID does not exist"
Sep 16 13:49:33.614097 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.614075    2552 scope.go:117] "RemoveContainer" containerID="df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"
Sep 16 13:49:33.614332 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:49:33.614314    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f\": container with ID starting with df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f not found: ID does not exist" containerID="df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"
Sep 16 13:49:33.614368 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.614339    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f"} err="failed to get container status \"df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f\": rpc error: code = NotFound desc = could not find container \"df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f\": container with ID starting with df4599e250fd152c20d66d5fe6bd399bcdb1c553a26d55ec1e44f1ac1198a82f not found: ID does not exist"
Sep 16 13:49:33.618312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.618292    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"]
Sep 16 13:49:33.622813 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.622792    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ab3aa7c0-openshift-default-7bc86454d-md9x2"]
Sep 16 13:49:33.839483 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:33.839451    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" path="/var/lib/kubelet/pods/0b8aeebf-b7ed-49b8-b28e-9a23be9f2993/volumes"
Sep 16 13:49:34.834556 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.834525    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:49:34.945664 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945592    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-podinfo\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945664 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945655    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-envoy\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945685    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-certs\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945703    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-token\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945736    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-credential-socket\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945755    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psl8m\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-kube-api-access-psl8m\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945798    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-socket\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945828    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-data\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.945881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945869    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istiod-ca-cert\") pod \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\" (UID: \"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94\") "
Sep 16 13:49:34.946241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.945980    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:34.946241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946005    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:34.946241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946154    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:34.946410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946349    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:34.946410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946284    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:49:34.946410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946367    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:34.946410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946387    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:34.946410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.946401    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:34.948162 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.948133    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-kube-api-access-psl8m" (OuterVolumeSpecName: "kube-api-access-psl8m") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "kube-api-access-psl8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:49:34.948456 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.948434    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:49:34.948603 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.948437    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:49:34.948664 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:34.948631    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" (UID: "b4a449ab-a7ec-4931-a6b2-48c0fca7ab94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:49:35.047804 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.047772    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:35.047804 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.047799    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:35.047949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.047812    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:35.047949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.047824    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:35.047949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.047835    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psl8m\" (UniqueName: \"kubernetes.io/projected/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-kube-api-access-psl8m\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:35.047949 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.047846    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:49:35.610979 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.610945    2552 generic.go:356] "Generic (PLEG): container finished" podID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerID="f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423" exitCode=0
Sep 16 13:49:35.611141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.611002    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"
Sep 16 13:49:35.611141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.611032    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" event={"ID":"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94","Type":"ContainerDied","Data":"f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423"}
Sep 16 13:49:35.611141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.611105    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q" event={"ID":"b4a449ab-a7ec-4931-a6b2-48c0fca7ab94","Type":"ContainerDied","Data":"1c32770e0c0ed095569772752c9e410cee53c006088b978b9c918d0c724210a9"}
Sep 16 13:49:35.611141 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.611128    2552 scope.go:117] "RemoveContainer" containerID="f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423"
Sep 16 13:49:35.620612 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.620598    2552 scope.go:117] "RemoveContainer" containerID="28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"
Sep 16 13:49:35.628409 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.628388    2552 scope.go:117] "RemoveContainer" containerID="f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423"
Sep 16 13:49:35.628697 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:49:35.628678    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423\": container with ID starting with f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423 not found: ID does not exist" containerID="f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423"
Sep 16 13:49:35.628775 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.628705    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423"} err="failed to get container status \"f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423\": rpc error: code = NotFound desc = could not find container \"f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423\": container with ID starting with f0d1df4cc8daf99f2667d29bec4ddbc648655b1f67f97b317655a5b385ad1423 not found: ID does not exist"
Sep 16 13:49:35.628775 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.628723    2552 scope.go:117] "RemoveContainer" containerID="28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"
Sep 16 13:49:35.628963 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:49:35.628948    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198\": container with ID starting with 28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198 not found: ID does not exist" containerID="28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"
Sep 16 13:49:35.629006 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.628968    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198"} err="failed to get container status \"28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198\": rpc error: code = NotFound desc = could not find container \"28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198\": container with ID starting with 28be67d19a518cfc7a80f97a82b3a772a2ff493d5799749c6ca6f208f316b198 not found: ID does not exist"
Sep 16 13:49:35.638576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.638557    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"]
Sep 16 13:49:35.647294 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.647271    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-4678b2-openshift-default-7d77f8d948-xjm2q"]
Sep 16 13:49:35.838765 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:35.838737    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" path="/var/lib/kubelet/pods/b4a449ab-a7ec-4931-a6b2-48c0fca7ab94/volumes"
Sep 16 13:49:42.317308 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317274    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"]
Sep 16 13:49:42.317898 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317878    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317900    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317912    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317919    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317931    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317939    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317954    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy"
Sep 16 13:49:42.317985 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.317962    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy"
Sep 16 13:49:42.318346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.318079    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy"
Sep 16 13:49:42.318346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.318090    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy"
Sep 16 13:49:42.318346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.318102    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a449ab-a7ec-4931-a6b2-48c0fca7ab94" containerName="istio-proxy"
Sep 16 13:49:42.318346 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.318111    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b8aeebf-b7ed-49b8-b28e-9a23be9f2993" containerName="istio-proxy"
Sep 16 13:49:42.321433 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.321411    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.324475 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.324451    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-aff7af-openshift-default-dockercfg-gf7t7\""
Sep 16 13:49:42.334710 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.334690    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"]
Sep 16 13:49:42.416162 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.416115    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-credential-socket\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.416449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.416421    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-data\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.416599 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.416584    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-socket\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.416745 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.416730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52658e31-b412-42b9-8367-f2f7b43b762f-istio-podinfo\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.416864 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.416850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-envoy\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.416994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.416982    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-certs\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.417114 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.417100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m52h5\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-kube-api-access-m52h5\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.417244 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.417231    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52658e31-b412-42b9-8367-f2f7b43b762f-istiod-ca-cert\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.417352 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.417340    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-istio-token\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518287 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518251    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-credential-socket\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518304    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-data\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518331    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-socket\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518365    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52658e31-b412-42b9-8367-f2f7b43b762f-istio-podinfo\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518388    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-envoy\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518426    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-certs\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518458    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m52h5\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-kube-api-access-m52h5\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518508    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52658e31-b412-42b9-8367-f2f7b43b762f-istiod-ca-cert\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518535    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-istio-token\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518675    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-credential-socket\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.518742 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.518723    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-data\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.519116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.519095    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-certs\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.519290 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.519272    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-socket\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.519446 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.519418    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52658e31-b412-42b9-8367-f2f7b43b762f-istiod-ca-cert\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.520850 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.520828    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-envoy\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.521074 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.521054    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52658e31-b412-42b9-8367-f2f7b43b762f-istio-podinfo\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.527303 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.527285    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-istio-token\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.527703 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.527681    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m52h5\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-kube-api-access-m52h5\") pod \"e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") " pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.634658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.634602    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:42.915176 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.915148    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"]
Sep 16 13:49:42.916850 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:49:42.916818    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52658e31_b412_42b9_8367_f2f7b43b762f.slice/crio-c840d6bc565552af0eb2eefa47efe3b0f2bb761025185f2c5df58c51e10abc33 WatchSource:0}: Error finding container c840d6bc565552af0eb2eefa47efe3b0f2bb761025185f2c5df58c51e10abc33: Status 404 returned error can't find the container with id c840d6bc565552af0eb2eefa47efe3b0f2bb761025185f2c5df58c51e10abc33
Sep 16 13:49:42.919391 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.919358    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:42.919447 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.919426    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:42.919494 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:42.919459    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:49:43.659147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:43.659113    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" event={"ID":"52658e31-b412-42b9-8367-f2f7b43b762f","Type":"ContainerStarted","Data":"51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"}
Sep 16 13:49:43.659508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:43.659175    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" event={"ID":"52658e31-b412-42b9-8367-f2f7b43b762f","Type":"ContainerStarted","Data":"c840d6bc565552af0eb2eefa47efe3b0f2bb761025185f2c5df58c51e10abc33"}
Sep 16 13:49:43.681818 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:43.681773    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podStartSLOduration=1.6817576779999999 podStartE2EDuration="1.681757678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:49:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:49:43.680588289 +0000 UTC m=+1128.434278411" watchObservedRunningTime="2026-09-16 13:49:43.681757678 +0000 UTC m=+1128.435447798"
Sep 16 13:49:44.635616 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:44.635577    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:44.641875 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:44.641845    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:44.666690 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:44.666662    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:44.667537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:44.667517    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:49:49.981184 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:49.981138    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"]
Sep 16 13:49:49.984792 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:49.984775    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:49.987503 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:49.987480    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-aff7af\""
Sep 16 13:49:49.987771 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:49.987748    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-aff7af-dockercfg-bgtzz\""
Sep 16 13:49:49.996108 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:49.996088    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"]
Sep 16 13:49:50.015591 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.015567    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"]
Sep 16 13:49:50.019455 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.019439    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.031645 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.031623    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"]
Sep 16 13:49:50.093337 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.093306    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vgh\" (UniqueName: \"kubernetes.io/projected/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-kube-api-access-x8vgh\") pod \"payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.093508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.093380    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e79e659-a29a-46fd-974c-9cefb2597724-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.093508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.093409    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.093508 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.093451    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9wm\" (UniqueName: \"kubernetes.io/projected/0e79e659-a29a-46fd-974c-9cefb2597724-kube-api-access-db9wm\") pod \"payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.194279 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.194241    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9wm\" (UniqueName: \"kubernetes.io/projected/0e79e659-a29a-46fd-974c-9cefb2597724-kube-api-access-db9wm\") pod \"payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.194438 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.194299    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vgh\" (UniqueName: \"kubernetes.io/projected/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-kube-api-access-x8vgh\") pod \"payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.194438 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.194375    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e79e659-a29a-46fd-974c-9cefb2597724-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.194438 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.194406    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.195138 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.195118    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e79e659-a29a-46fd-974c-9cefb2597724-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.195199 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.195148    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.202863 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.202835    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9wm\" (UniqueName: \"kubernetes.io/projected/0e79e659-a29a-46fd-974c-9cefb2597724-kube-api-access-db9wm\") pod \"payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.203067 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.203045    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vgh\" (UniqueName: \"kubernetes.io/projected/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-kube-api-access-x8vgh\") pod \"payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.296365 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.296341    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.329450 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.329418    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.575158 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.575135    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"]
Sep 16 13:49:50.577033 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:49:50.577009    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e79e659_a29a_46fd_974c_9cefb2597724.slice/crio-f506288f5e2a26b80f9fec3497d047123011e9115d537ec245410d03853fcf46 WatchSource:0}: Error finding container f506288f5e2a26b80f9fec3497d047123011e9115d537ec245410d03853fcf46: Status 404 returned error can't find the container with id f506288f5e2a26b80f9fec3497d047123011e9115d537ec245410d03853fcf46
Sep 16 13:49:50.615862 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.615841    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"]
Sep 16 13:49:50.616784 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:49:50.616756    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cded68a_0a5b_4f8d_abf8_dd9bd44b3418.slice/crio-65d90319fb78fa49c2223c01e5ffd78ef8304f5d41521b0463f03c16ee0f209a WatchSource:0}: Error finding container 65d90319fb78fa49c2223c01e5ffd78ef8304f5d41521b0463f03c16ee0f209a: Status 404 returned error can't find the container with id 65d90319fb78fa49c2223c01e5ffd78ef8304f5d41521b0463f03c16ee0f209a
Sep 16 13:49:50.702038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.702012    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd" event={"ID":"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418","Type":"ContainerStarted","Data":"6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d"}
Sep 16 13:49:50.702172 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.702090    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd" event={"ID":"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418","Type":"ContainerStarted","Data":"65d90319fb78fa49c2223c01e5ffd78ef8304f5d41521b0463f03c16ee0f209a"}
Sep 16 13:49:50.702469 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.702449    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:49:50.703752 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.703730    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f" event={"ID":"0e79e659-a29a-46fd-974c-9cefb2597724","Type":"ContainerStarted","Data":"c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b"}
Sep 16 13:49:50.703857 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.703783    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:49:50.703857 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.703809    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f" event={"ID":"0e79e659-a29a-46fd-974c-9cefb2597724","Type":"ContainerStarted","Data":"f506288f5e2a26b80f9fec3497d047123011e9115d537ec245410d03853fcf46"}
Sep 16 13:49:50.722982 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.722931    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd" podStartSLOduration=1.722907167 podStartE2EDuration="1.722907167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:49:50.719375325 +0000 UTC m=+1135.473065449" watchObservedRunningTime="2026-09-16 13:49:50.722907167 +0000 UTC m=+1135.476597291"
Sep 16 13:49:50.739259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:49:50.739219    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f" podStartSLOduration=1.739206231 podStartE2EDuration="1.739206231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:49:50.736476919 +0000 UTC m=+1135.490167042" watchObservedRunningTime="2026-09-16 13:49:50.739206231 +0000 UTC m=+1135.492896349"
Sep 16 13:50:01.712230 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:01.712204    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:50:01.712627 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:01.712270    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:50:05.220078 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.220043    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"]
Sep 16 13:50:05.225064 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.225044    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:05.227878 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.227854    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:50:05.234772 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.234751    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"]
Sep 16 13:50:05.335310 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.335274    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d62653-6515-4017-8b1d-66a93c708305-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x\" (UID: \"b0d62653-6515-4017-8b1d-66a93c708305\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:05.436565 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.436510    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d62653-6515-4017-8b1d-66a93c708305-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x\" (UID: \"b0d62653-6515-4017-8b1d-66a93c708305\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:05.437147 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.437127    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d62653-6515-4017-8b1d-66a93c708305-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x\" (UID: \"b0d62653-6515-4017-8b1d-66a93c708305\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:05.536184 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.536151    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:05.858576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:05.855659    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"]
Sep 16 13:50:06.804021 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:06.803993    2552 generic.go:356] "Generic (PLEG): container finished" podID="b0d62653-6515-4017-8b1d-66a93c708305" containerID="e1ec45e2022c133ebd46c52b5bc723d2f19b26f16c2ee33b0672b817ccbd18cb" exitCode=0
Sep 16 13:50:06.804350 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:06.804076    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x" event={"ID":"b0d62653-6515-4017-8b1d-66a93c708305","Type":"ContainerDied","Data":"e1ec45e2022c133ebd46c52b5bc723d2f19b26f16c2ee33b0672b817ccbd18cb"}
Sep 16 13:50:06.804350 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:06.804145    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x" event={"ID":"b0d62653-6515-4017-8b1d-66a93c708305","Type":"ContainerStarted","Data":"5ce87fe0bcc98c507bf855aa3acb7144d1b8ca6aeaa910eb3b02ed505bae72cc"}
Sep 16 13:50:07.999961 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:07.999937    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:08.073045 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:08.072961    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d62653-6515-4017-8b1d-66a93c708305-maas-api-service-ca\") pod \"b0d62653-6515-4017-8b1d-66a93c708305\" (UID: \"b0d62653-6515-4017-8b1d-66a93c708305\") "
Sep 16 13:50:08.073377 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:08.073347    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d62653-6515-4017-8b1d-66a93c708305-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0d62653-6515-4017-8b1d-66a93c708305" (UID: "b0d62653-6515-4017-8b1d-66a93c708305"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:08.174533 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:08.174499    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d62653-6515-4017-8b1d-66a93c708305-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:08.820007 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:08.819981    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"
Sep 16 13:50:08.820007 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:08.819999    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x" event={"ID":"b0d62653-6515-4017-8b1d-66a93c708305","Type":"ContainerDied","Data":"5ce87fe0bcc98c507bf855aa3acb7144d1b8ca6aeaa910eb3b02ed505bae72cc"}
Sep 16 13:50:08.820212 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:08.820045    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ce87fe0bcc98c507bf855aa3acb7144d1b8ca6aeaa910eb3b02ed505bae72cc"
Sep 16 13:50:12.846184 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:12.846146    2552 generic.go:356] "Generic (PLEG): container finished" podID="52658e31-b412-42b9-8367-f2f7b43b762f" containerID="51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168" exitCode=0
Sep 16 13:50:12.846604 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:12.846216    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" event={"ID":"52658e31-b412-42b9-8367-f2f7b43b762f","Type":"ContainerDied","Data":"51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"}
Sep 16 13:50:12.846769 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:12.846753    2552 scope.go:117] "RemoveContainer" containerID="51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"
Sep 16 13:50:12.848164 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:12.848141    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:50:12.848232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:12.848204    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:50:12.848274 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:12.848235    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:50:13.873349 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:13.873317    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" event={"ID":"52658e31-b412-42b9-8367-f2f7b43b762f","Type":"ContainerStarted","Data":"adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100"}
Sep 16 13:50:14.635260 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:14.635230    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:50:14.636568 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:14.636525    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:50:14.636700 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:14.636588    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:50:14.667256 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:14.667217    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:50:15.635964 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:15.635927    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:50:15.636371 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:15.635977    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:50:16.429159 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.429127    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"]
Sep 16 13:50:16.434259 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.434234    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-aca190-29826105-rd5kw"]
Sep 16 13:50:16.467568 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.466744    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"]
Sep 16 13:50:16.467568 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.466984    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p" podUID="dfd504e5-dce6-4d18-9412-9aa49a7b1212" containerName="payload-processing" containerID="cri-o://7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e" gracePeriod=30
Sep 16 13:50:16.475691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.474703    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"]
Sep 16 13:50:16.475691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.474910    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6" podUID="beac1774-1984-4cfa-a0a0-4f814988643a" containerName="payload-pre-processing" containerID="cri-o://0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70" gracePeriod=30
Sep 16 13:50:16.635661 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.635107    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:50:16.635661 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.635173    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:50:16.806316 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.806295    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:50:16.866395 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.866125    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:50:16.898179 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.898018    2552 generic.go:356] "Generic (PLEG): container finished" podID="beac1774-1984-4cfa-a0a0-4f814988643a" containerID="0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70" exitCode=0
Sep 16 13:50:16.898179 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.898155    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6" event={"ID":"beac1774-1984-4cfa-a0a0-4f814988643a","Type":"ContainerDied","Data":"0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70"}
Sep 16 13:50:16.898416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.898227    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"
Sep 16 13:50:16.898416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.898310    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6" event={"ID":"beac1774-1984-4cfa-a0a0-4f814988643a","Type":"ContainerDied","Data":"5d68ca4ee8708f005f4b478b4fa11fe0f59870b5b21dd9af5f35a5b60de9e4ab"}
Sep 16 13:50:16.898660 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.898634    2552 scope.go:117] "RemoveContainer" containerID="0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70"
Sep 16 13:50:16.900727 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.900701    2552 generic.go:356] "Generic (PLEG): container finished" podID="dfd504e5-dce6-4d18-9412-9aa49a7b1212" containerID="7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e" exitCode=0
Sep 16 13:50:16.900810 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.900747    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p" event={"ID":"dfd504e5-dce6-4d18-9412-9aa49a7b1212","Type":"ContainerDied","Data":"7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e"}
Sep 16 13:50:16.900810 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.900780    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"
Sep 16 13:50:16.900810 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.900796    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p" event={"ID":"dfd504e5-dce6-4d18-9412-9aa49a7b1212","Type":"ContainerDied","Data":"a0320fe4ed81fad9b6c6abbb940b65f65769501da2a3129d896aba00c27c116f"}
Sep 16 13:50:16.910232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.910174    2552 scope.go:117] "RemoveContainer" containerID="0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70"
Sep 16 13:50:16.911325 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:50:16.910535    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70\": container with ID starting with 0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70 not found: ID does not exist" containerID="0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70"
Sep 16 13:50:16.911429 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.911346    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70"} err="failed to get container status \"0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70\": rpc error: code = NotFound desc = could not find container \"0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70\": container with ID starting with 0413ea4c2a90d5df106bf9afcb2d065f9a13939545ab88895f6e895327f0dc70 not found: ID does not exist"
Sep 16 13:50:16.911429 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.911375    2552 scope.go:117] "RemoveContainer" containerID="7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e"
Sep 16 13:50:16.921435 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.921412    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"]
Sep 16 13:50:16.923606 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.923584    2552 scope.go:117] "RemoveContainer" containerID="7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e"
Sep 16 13:50:16.923890 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:50:16.923861    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e\": container with ID starting with 7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e not found: ID does not exist" containerID="7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e"
Sep 16 13:50:16.923890 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.923885    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e"} err="failed to get container status \"7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e\": rpc error: code = NotFound desc = could not find container \"7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e\": container with ID starting with 7c3b33b5648d554f1dbeadcdbf58e4076cf90715c1180ecfeb3df0d6cd95e61e not found: ID does not exist"
Sep 16 13:50:16.928828 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.928803    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aca190-k9x9x"]
Sep 16 13:50:16.980958 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.980928    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6k9r\" (UniqueName: \"kubernetes.io/projected/beac1774-1984-4cfa-a0a0-4f814988643a-kube-api-access-f6k9r\") pod \"beac1774-1984-4cfa-a0a0-4f814988643a\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") "
Sep 16 13:50:16.981123 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.981065    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgkmd\" (UniqueName: \"kubernetes.io/projected/dfd504e5-dce6-4d18-9412-9aa49a7b1212-kube-api-access-zgkmd\") pod \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") "
Sep 16 13:50:16.981123 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.981087    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd504e5-dce6-4d18-9412-9aa49a7b1212-plugins-config-volume\") pod \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\" (UID: \"dfd504e5-dce6-4d18-9412-9aa49a7b1212\") "
Sep 16 13:50:16.981123 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.981112    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beac1774-1984-4cfa-a0a0-4f814988643a-plugins-config-volume\") pod \"beac1774-1984-4cfa-a0a0-4f814988643a\" (UID: \"beac1774-1984-4cfa-a0a0-4f814988643a\") "
Sep 16 13:50:16.981489 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.981442    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd504e5-dce6-4d18-9412-9aa49a7b1212-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfd504e5-dce6-4d18-9412-9aa49a7b1212" (UID: "dfd504e5-dce6-4d18-9412-9aa49a7b1212"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:16.981588 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.981529    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beac1774-1984-4cfa-a0a0-4f814988643a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "beac1774-1984-4cfa-a0a0-4f814988643a" (UID: "beac1774-1984-4cfa-a0a0-4f814988643a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:16.983206 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.983189    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd504e5-dce6-4d18-9412-9aa49a7b1212-kube-api-access-zgkmd" (OuterVolumeSpecName: "kube-api-access-zgkmd") pod "dfd504e5-dce6-4d18-9412-9aa49a7b1212" (UID: "dfd504e5-dce6-4d18-9412-9aa49a7b1212"). InnerVolumeSpecName "kube-api-access-zgkmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:16.983285 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:16.983273    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beac1774-1984-4cfa-a0a0-4f814988643a-kube-api-access-f6k9r" (OuterVolumeSpecName: "kube-api-access-f6k9r") pod "beac1774-1984-4cfa-a0a0-4f814988643a" (UID: "beac1774-1984-4cfa-a0a0-4f814988643a"). InnerVolumeSpecName "kube-api-access-f6k9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:17.082291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.082253    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/beac1774-1984-4cfa-a0a0-4f814988643a-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:17.082291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.082283    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6k9r\" (UniqueName: \"kubernetes.io/projected/beac1774-1984-4cfa-a0a0-4f814988643a-kube-api-access-f6k9r\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:17.082291 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.082292    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgkmd\" (UniqueName: \"kubernetes.io/projected/dfd504e5-dce6-4d18-9412-9aa49a7b1212-kube-api-access-zgkmd\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:17.082573 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.082303    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfd504e5-dce6-4d18-9412-9aa49a7b1212-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:17.235376 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.235348    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"]
Sep 16 13:50:17.247812 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.247778    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-aca190-5ddc4c6c46-lp4f6"]
Sep 16 13:50:17.287987 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.287949    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"]
Sep 16 13:50:17.292387 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.292358    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-aca190-6f9ff77bd7-j9d7p"]
Sep 16 13:50:17.635682 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.635649    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:50:17.635852 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.635720    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:50:17.839290 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.839252    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9aa371-a48a-438f-aa81-b68c7deab9a4" path="/var/lib/kubelet/pods/9a9aa371-a48a-438f-aa81-b68c7deab9a4/volumes"
Sep 16 13:50:17.839740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.839595    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d62653-6515-4017-8b1d-66a93c708305" path="/var/lib/kubelet/pods/b0d62653-6515-4017-8b1d-66a93c708305/volumes"
Sep 16 13:50:17.839942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.839927    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beac1774-1984-4cfa-a0a0-4f814988643a" path="/var/lib/kubelet/pods/beac1774-1984-4cfa-a0a0-4f814988643a/volumes"
Sep 16 13:50:17.840255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:17.840242    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd504e5-dce6-4d18-9412-9aa49a7b1212" path="/var/lib/kubelet/pods/dfd504e5-dce6-4d18-9412-9aa49a7b1212/volumes"
Sep 16 13:50:18.635605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:18.635571    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:50:18.635783 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:18.635642    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:50:19.639383 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:19.639357    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:50:19.640313 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:19.640290    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:50:21.355116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355081    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"]
Sep 16 13:50:21.355538 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355525    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d62653-6515-4017-8b1d-66a93c708305" containerName="revoke-keys"
Sep 16 13:50:21.355538 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355565    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d62653-6515-4017-8b1d-66a93c708305" containerName="revoke-keys"
Sep 16 13:50:21.355668 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355583    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beac1774-1984-4cfa-a0a0-4f814988643a" containerName="payload-pre-processing"
Sep 16 13:50:21.355668 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355589    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="beac1774-1984-4cfa-a0a0-4f814988643a" containerName="payload-pre-processing"
Sep 16 13:50:21.355668 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355596    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd504e5-dce6-4d18-9412-9aa49a7b1212" containerName="payload-processing"
Sep 16 13:50:21.355668 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355602    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd504e5-dce6-4d18-9412-9aa49a7b1212" containerName="payload-processing"
Sep 16 13:50:21.355809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355675    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd504e5-dce6-4d18-9412-9aa49a7b1212" containerName="payload-processing"
Sep 16 13:50:21.355809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355681    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d62653-6515-4017-8b1d-66a93c708305" containerName="revoke-keys"
Sep 16 13:50:21.355809 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.355691    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="beac1774-1984-4cfa-a0a0-4f814988643a" containerName="payload-pre-processing"
Sep 16 13:50:21.358966 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.358946    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.364396 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.364372    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f2afd5-dockercfg-nsgvn\""
Sep 16 13:50:21.364769 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.364747    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f2afd5\""
Sep 16 13:50:21.372568 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.372528    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"]
Sep 16 13:50:21.417856 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.417832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69030757-7ba0-46a5-ae9a-383f0ef5e198-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.417958 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.417871    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn7s2\" (UniqueName: \"kubernetes.io/projected/69030757-7ba0-46a5-ae9a-383f0ef5e198-kube-api-access-gn7s2\") pod \"payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.456967 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.456923    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"]
Sep 16 13:50:21.460468 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.460422    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.473688 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.473658    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"]
Sep 16 13:50:21.519034 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.519007    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn7s2\" (UniqueName: \"kubernetes.io/projected/69030757-7ba0-46a5-ae9a-383f0ef5e198-kube-api-access-gn7s2\") pod \"payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.519183 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.519052    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5g46\" (UniqueName: \"kubernetes.io/projected/b1b56e98-941d-435e-bb0a-3ef78896aaa8-kube-api-access-s5g46\") pod \"payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.519183 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.519085    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b56e98-941d-435e-bb0a-3ef78896aaa8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.519183 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.519169    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69030757-7ba0-46a5-ae9a-383f0ef5e198-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.519820 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.519800    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69030757-7ba0-46a5-ae9a-383f0ef5e198-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.528079 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.528047    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn7s2\" (UniqueName: \"kubernetes.io/projected/69030757-7ba0-46a5-ae9a-383f0ef5e198-kube-api-access-gn7s2\") pod \"payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.620058 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.619984    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5g46\" (UniqueName: \"kubernetes.io/projected/b1b56e98-941d-435e-bb0a-3ef78896aaa8-kube-api-access-s5g46\") pod \"payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.620058 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.620034    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b56e98-941d-435e-bb0a-3ef78896aaa8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.620680 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.620663    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b56e98-941d-435e-bb0a-3ef78896aaa8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.633227 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.633205    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5g46\" (UniqueName: \"kubernetes.io/projected/b1b56e98-941d-435e-bb0a-3ef78896aaa8-kube-api-access-s5g46\") pod \"payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.669946 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.669909    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:21.780942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.780909    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:21.952736 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:21.952708    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"]
Sep 16 13:50:21.954877 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:50:21.954850    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69030757_7ba0_46a5_ae9a_383f0ef5e198.slice/crio-cc586ee87b96e5bf8d3b715b47da32094e081f7da58297b3c0bddc3c5190f5f7 WatchSource:0}: Error finding container cc586ee87b96e5bf8d3b715b47da32094e081f7da58297b3c0bddc3c5190f5f7: Status 404 returned error can't find the container with id cc586ee87b96e5bf8d3b715b47da32094e081f7da58297b3c0bddc3c5190f5f7
Sep 16 13:50:22.053440 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.053415    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"]
Sep 16 13:50:22.054957 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:50:22.054930    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b56e98_941d_435e_bb0a_3ef78896aaa8.slice/crio-daaaa9f77278c364666dc853709c6a75cfbd7b35f4074ff7f0a333bd049058d0 WatchSource:0}: Error finding container daaaa9f77278c364666dc853709c6a75cfbd7b35f4074ff7f0a333bd049058d0: Status 404 returned error can't find the container with id daaaa9f77278c364666dc853709c6a75cfbd7b35f4074ff7f0a333bd049058d0
Sep 16 13:50:22.940514 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.940476    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf" event={"ID":"69030757-7ba0-46a5-ae9a-383f0ef5e198","Type":"ContainerStarted","Data":"8e30d04b1a9d5486bd80f94f566b09b3ca1fdb30c8245cca5ab3985263785ea8"}
Sep 16 13:50:22.941024 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.940567    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf" event={"ID":"69030757-7ba0-46a5-ae9a-383f0ef5e198","Type":"ContainerStarted","Data":"cc586ee87b96e5bf8d3b715b47da32094e081f7da58297b3c0bddc3c5190f5f7"}
Sep 16 13:50:22.941024 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.940604    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:22.942267 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.942237    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7" event={"ID":"b1b56e98-941d-435e-bb0a-3ef78896aaa8","Type":"ContainerStarted","Data":"9b5ef0e9ffec295284bd4800f2f3f3a0b645dc0586df29f0f80039f86369bbed"}
Sep 16 13:50:22.942416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.942289    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7" event={"ID":"b1b56e98-941d-435e-bb0a-3ef78896aaa8","Type":"ContainerStarted","Data":"daaaa9f77278c364666dc853709c6a75cfbd7b35f4074ff7f0a333bd049058d0"}
Sep 16 13:50:22.942416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.942335    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:22.967755 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.967714    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf" podStartSLOduration=1.9677008169999999 podStartE2EDuration="1.967700817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:50:22.964488588 +0000 UTC m=+1167.718178714" watchObservedRunningTime="2026-09-16 13:50:22.967700817 +0000 UTC m=+1167.721390938"
Sep 16 13:50:22.990639 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:22.990595    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7" podStartSLOduration=1.990577537 podStartE2EDuration="1.990577537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:50:22.989857638 +0000 UTC m=+1167.743547762" watchObservedRunningTime="2026-09-16 13:50:22.990577537 +0000 UTC m=+1167.744267660"
Sep 16 13:50:33.951893 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:33.951863    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:50:33.952348 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:33.952183    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:50:34.554003 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:34.553973    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"]
Sep 16 13:50:34.554272 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:34.554222    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf" podUID="2c434304-078d-4620-b702-ac937e79efcf" containerName="istio-proxy" containerID="cri-o://24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0" gracePeriod=30
Sep 16 13:50:34.991289 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:34.991179    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"]
Sep 16 13:50:34.991753 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:34.991418    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz" podUID="741332d4-8dad-4c75-a9a6-83630dc538a0" containerName="payload-pre-processing" containerID="cri-o://d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6" gracePeriod=30
Sep 16 13:50:35.256314 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.256285    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:50:35.351392 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.351359    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbc8z\" (UniqueName: \"kubernetes.io/projected/741332d4-8dad-4c75-a9a6-83630dc538a0-kube-api-access-gbc8z\") pod \"741332d4-8dad-4c75-a9a6-83630dc538a0\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") "
Sep 16 13:50:35.351622 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.351476    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741332d4-8dad-4c75-a9a6-83630dc538a0-plugins-config-volume\") pod \"741332d4-8dad-4c75-a9a6-83630dc538a0\" (UID: \"741332d4-8dad-4c75-a9a6-83630dc538a0\") "
Sep 16 13:50:35.352154 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.352125    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741332d4-8dad-4c75-a9a6-83630dc538a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "741332d4-8dad-4c75-a9a6-83630dc538a0" (UID: "741332d4-8dad-4c75-a9a6-83630dc538a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:35.354043 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.354004    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741332d4-8dad-4c75-a9a6-83630dc538a0-kube-api-access-gbc8z" (OuterVolumeSpecName: "kube-api-access-gbc8z") pod "741332d4-8dad-4c75-a9a6-83630dc538a0" (UID: "741332d4-8dad-4c75-a9a6-83630dc538a0"). InnerVolumeSpecName "kube-api-access-gbc8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:35.452623 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.452589    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbc8z\" (UniqueName: \"kubernetes.io/projected/741332d4-8dad-4c75-a9a6-83630dc538a0-kube-api-access-gbc8z\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:35.452623 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:35.452613    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741332d4-8dad-4c75-a9a6-83630dc538a0-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:36.023473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.023435    2552 generic.go:356] "Generic (PLEG): container finished" podID="741332d4-8dad-4c75-a9a6-83630dc538a0" containerID="d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6" exitCode=0
Sep 16 13:50:36.023930 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.023491    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"
Sep 16 13:50:36.023930 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.023501    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz" event={"ID":"741332d4-8dad-4c75-a9a6-83630dc538a0","Type":"ContainerDied","Data":"d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6"}
Sep 16 13:50:36.023930 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.023568    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz" event={"ID":"741332d4-8dad-4c75-a9a6-83630dc538a0","Type":"ContainerDied","Data":"08f0d12e01fb8d92864ca67ed5d7ae4d035b6cf8714316f0441ca2fa78111452"}
Sep 16 13:50:36.023930 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.023590    2552 scope.go:117] "RemoveContainer" containerID="d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6"
Sep 16 13:50:36.032638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.032619    2552 scope.go:117] "RemoveContainer" containerID="d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6"
Sep 16 13:50:36.032886 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:50:36.032867    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6\": container with ID starting with d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6 not found: ID does not exist" containerID="d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6"
Sep 16 13:50:36.032938 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.032893    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6"} err="failed to get container status \"d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6\": rpc error: code = NotFound desc = could not find container \"d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6\": container with ID starting with d769da9faa21370283151484564e688a904e212599e6253e305c36cf8f054ab6 not found: ID does not exist"
Sep 16 13:50:36.042939 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.042917    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"]
Sep 16 13:50:36.049416 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:36.049397    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1e5db0-5c544d854b-ctcwz"]
Sep 16 13:50:37.838604 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:37.838571    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741332d4-8dad-4c75-a9a6-83630dc538a0" path="/var/lib/kubelet/pods/741332d4-8dad-4c75-a9a6-83630dc538a0/volumes"
Sep 16 13:50:39.813397 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.813330    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:50:39.893419 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893392    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-envoy\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893431    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-istio-token\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893459    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-socket\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893483    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c434304-078d-4620-b702-ac937e79efcf-istio-podinfo\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893516    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-certs\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893593 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893593    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c434304-078d-4620-b702-ac937e79efcf-istiod-ca-cert\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893875 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893646    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-credential-socket\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893875 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893684    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8d8f\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-kube-api-access-l8d8f\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893875 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893777    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-data\") pod \"2c434304-078d-4620-b702-ac937e79efcf\" (UID: \"2c434304-078d-4620-b702-ac937e79efcf\") "
Sep 16 13:50:39.893875 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893778    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:50:39.894090 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893894    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:50:39.894090 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893935    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:50:39.894090 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.893983    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c434304-078d-4620-b702-ac937e79efcf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:50:39.894261 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.894129    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:50:39.894261 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.894254    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c434304-078d-4620-b702-ac937e79efcf-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.894343 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.894275    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.894343 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.894289    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.894343 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.894321    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.896111 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.896074    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-kube-api-access-l8d8f" (OuterVolumeSpecName: "kube-api-access-l8d8f") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "kube-api-access-l8d8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:39.896270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.896118    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:50:39.896410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.896392    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:50:39.896455 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.896406    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c434304-078d-4620-b702-ac937e79efcf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c434304-078d-4620-b702-ac937e79efcf" (UID: "2c434304-078d-4620-b702-ac937e79efcf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:50:39.994854 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.994831    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8d8f\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-kube-api-access-l8d8f\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.994854 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.994852    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.995013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.994861    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c434304-078d-4620-b702-ac937e79efcf-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.995013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.994870    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c434304-078d-4620-b702-ac937e79efcf-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:39.995013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:39.994878    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c434304-078d-4620-b702-ac937e79efcf-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:50:40.051709 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.051679    2552 generic.go:356] "Generic (PLEG): container finished" podID="2c434304-078d-4620-b702-ac937e79efcf" containerID="24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0" exitCode=0
Sep 16 13:50:40.051842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.051726    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"
Sep 16 13:50:40.051842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.051768    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf" event={"ID":"2c434304-078d-4620-b702-ac937e79efcf","Type":"ContainerDied","Data":"24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0"}
Sep 16 13:50:40.051842 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.051822    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf" event={"ID":"2c434304-078d-4620-b702-ac937e79efcf","Type":"ContainerDied","Data":"380050d1e682f77718273125e88bce908da285c7985c50b2aa45bd638a2e8391"}
Sep 16 13:50:40.052009 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.051844    2552 scope.go:117] "RemoveContainer" containerID="24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0"
Sep 16 13:50:40.062428 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.062411    2552 scope.go:117] "RemoveContainer" containerID="24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0"
Sep 16 13:50:40.062698 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:50:40.062680    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0\": container with ID starting with 24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0 not found: ID does not exist" containerID="24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0"
Sep 16 13:50:40.062750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.062705    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0"} err="failed to get container status \"24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0\": rpc error: code = NotFound desc = could not find container \"24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0\": container with ID starting with 24c080aef8e960c6a015b7c99e8f99dd37d4d40a2748962855162390c20ebfb0 not found: ID does not exist"
Sep 16 13:50:40.084623 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.084556    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"]
Sep 16 13:50:40.096477 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:40.096411    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-2b6ce0-openshift-default-56dfc46748-kmvxf"]
Sep 16 13:50:41.837760 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:41.837729    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c434304-078d-4620-b702-ac937e79efcf" path="/var/lib/kubelet/pods/2c434304-078d-4620-b702-ac937e79efcf/volumes"
Sep 16 13:50:43.313105 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313069    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"]
Sep 16 13:50:43.313753 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313734    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c434304-078d-4620-b702-ac937e79efcf" containerName="istio-proxy"
Sep 16 13:50:43.313861 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313754    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c434304-078d-4620-b702-ac937e79efcf" containerName="istio-proxy"
Sep 16 13:50:43.313861 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313776    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741332d4-8dad-4c75-a9a6-83630dc538a0" containerName="payload-pre-processing"
Sep 16 13:50:43.313861 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313784    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="741332d4-8dad-4c75-a9a6-83630dc538a0" containerName="payload-pre-processing"
Sep 16 13:50:43.314022 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313898    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c434304-078d-4620-b702-ac937e79efcf" containerName="istio-proxy"
Sep 16 13:50:43.314022 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.313913    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="741332d4-8dad-4c75-a9a6-83630dc538a0" containerName="payload-pre-processing"
Sep 16 13:50:43.317223 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.317202    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.320659 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.320638    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-973610-openshift-default-dockercfg-xdbtc\""
Sep 16 13:50:43.331240 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.331220    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"]
Sep 16 13:50:43.429616 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429585    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-podinfo\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429622    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-token\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429692    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-envoy\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429745    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-certs\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429775    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-socket\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429952 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429793    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istiod-ca-cert\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429952 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429825    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm57k\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-kube-api-access-gm57k\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429952 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429877    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-credential-socket\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.429952 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.429935    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-data\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531157 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531112    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-podinfo\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531157 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531152    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-token\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531195    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-envoy\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531235    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-certs\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531268    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-socket\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istiod-ca-cert\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531335    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm57k\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-kube-api-access-gm57k\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531359    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-credential-socket\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531736 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531397    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-data\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531755    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-certs\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.531796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531782    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-socket\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.532016 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531942    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-credential-socket\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.532016 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.531997    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-data\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.532350 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.532323    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istiod-ca-cert\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.533614 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.533591    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-envoy\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.533815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.533801    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-podinfo\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.540044 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.540017    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm57k\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-kube-api-access-gm57k\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.540628 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.540596    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-token\") pod \"e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") " pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.628390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.628331    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:43.909116 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.909091    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"]
Sep 16 13:50:43.910869 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:50:43.910838    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c792cb_b867_4a1f_ae6c_47180b56e6fc.slice/crio-99e4521787b5e24a7625db1032655bee09803413652f42ddffe5d356afba4d33 WatchSource:0}: Error finding container 99e4521787b5e24a7625db1032655bee09803413652f42ddffe5d356afba4d33: Status 404 returned error can't find the container with id 99e4521787b5e24a7625db1032655bee09803413652f42ddffe5d356afba4d33
Sep 16 13:50:43.913431 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.913385    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:50:43.913503 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.913480    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:50:43.913565 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:43.913522    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:50:44.080404 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:44.080363    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" event={"ID":"43c792cb-b867-4a1f-ae6c-47180b56e6fc","Type":"ContainerStarted","Data":"4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"}
Sep 16 13:50:44.080595 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:44.080421    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" event={"ID":"43c792cb-b867-4a1f-ae6c-47180b56e6fc","Type":"ContainerStarted","Data":"99e4521787b5e24a7625db1032655bee09803413652f42ddffe5d356afba4d33"}
Sep 16 13:50:44.108401 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:44.108350    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podStartSLOduration=1.108334299 podStartE2EDuration="1.108334299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:50:44.107529059 +0000 UTC m=+1188.861219180" watchObservedRunningTime="2026-09-16 13:50:44.108334299 +0000 UTC m=+1188.862024419"
Sep 16 13:50:44.628728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:44.628696    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:44.633878 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:44.633856    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:45.086574 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:45.086514    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:45.087352 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:45.087333    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:50:51.961042 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:51.961010    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"]
Sep 16 13:50:51.963703 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:51.963676    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:51.968739 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:51.968707    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-973610\""
Sep 16 13:50:51.972050 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:51.972017    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-973610-dockercfg-6qklp\""
Sep 16 13:50:51.980186 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:51.980161    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"]
Sep 16 13:50:52.117421 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.117388    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7xdr\" (UniqueName: \"kubernetes.io/projected/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-kube-api-access-s7xdr\") pod \"payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.117603 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.117474    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.218711 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.218631    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xdr\" (UniqueName: \"kubernetes.io/projected/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-kube-api-access-s7xdr\") pod \"payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.218847 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.218716    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.219676 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.219653    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.228016 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.227983    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7xdr\" (UniqueName: \"kubernetes.io/projected/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-kube-api-access-s7xdr\") pod \"payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.275229 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.275200    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:52.547824 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:52.547796    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"]
Sep 16 13:50:52.549535 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:50:52.549508    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode189ec4c_39f6_4d45_8f09_f2fa16e43f78.slice/crio-dac1f8bdd422aabacf3e8cb00229cb0016c8c754dad1a449634398adbb8b72ec WatchSource:0}: Error finding container dac1f8bdd422aabacf3e8cb00229cb0016c8c754dad1a449634398adbb8b72ec: Status 404 returned error can't find the container with id dac1f8bdd422aabacf3e8cb00229cb0016c8c754dad1a449634398adbb8b72ec
Sep 16 13:50:53.140877 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:53.140839    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg" event={"ID":"e189ec4c-39f6-4d45-8f09-f2fa16e43f78","Type":"ContainerStarted","Data":"eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda"}
Sep 16 13:50:53.141292 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:53.141012    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:50:53.141292 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:53.141052    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg" event={"ID":"e189ec4c-39f6-4d45-8f09-f2fa16e43f78","Type":"ContainerStarted","Data":"dac1f8bdd422aabacf3e8cb00229cb0016c8c754dad1a449634398adbb8b72ec"}
Sep 16 13:50:53.161236 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:53.161186    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg" podStartSLOduration=2.161172617 podStartE2EDuration="2.161172617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:50:53.159459769 +0000 UTC m=+1197.913149892" watchObservedRunningTime="2026-09-16 13:50:53.161172617 +0000 UTC m=+1197.914862766"
Sep 16 13:50:55.702978 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:55.702948    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:50:55.703887 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:50:55.703868    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:51:03.455795 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.455760    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"]
Sep 16 13:51:03.462389 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.462351    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:03.465840 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:51:03.465802    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" podUID="50ce822d-8a00-47de-948d-407a4f10856a" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:03.465985 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:51:03.465925    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-mt-c5dc2482\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c5dc2482\"" type="*v1.ConfigMap"
Sep 16 13:51:03.466137 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:51:03.466102    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-mt-c5dc2482-dockercfg-8s427\" is forbidden: User \"system:node:ip-10-0-129-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c5dc2482-dockercfg-8s427\"" type="*v1.Secret"
Sep 16 13:51:03.477834 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.477809    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"]
Sep 16 13:51:03.534028 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.532332    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jgn\" (UniqueName: \"kubernetes.io/projected/50ce822d-8a00-47de-948d-407a4f10856a-kube-api-access-n7jgn\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:03.534028 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.532476    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:03.633278 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.633243    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jgn\" (UniqueName: \"kubernetes.io/projected/50ce822d-8a00-47de-948d-407a4f10856a-kube-api-access-n7jgn\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:03.633432 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.633321    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:03.643083 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:03.643053    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jgn\" (UniqueName: \"kubernetes.io/projected/50ce822d-8a00-47de-948d-407a4f10856a-kube-api-access-n7jgn\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:04.151415 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:04.151385    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 13:51:04.634493 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:51:04.634468    2552 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-mt-c5dc2482: failed to sync configmap cache: timed out waiting for the condition
Sep 16 13:51:04.634885 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:51:04.634562    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume podName:50ce822d-8a00-47de-948d-407a4f10856a nodeName:}" failed. No retries permitted until 2026-09-16 13:51:05.134528303 +0000 UTC m=+1209.888218401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume") pod "payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" (UID: "50ce822d-8a00-47de-948d-407a4f10856a") : failed to sync configmap cache: timed out waiting for the condition
Sep 16 13:51:05.030217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:05.030189    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c5dc2482\""
Sep 16 13:51:05.068881 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:05.068862    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c5dc2482-dockercfg-8s427\""
Sep 16 13:51:05.145951 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:05.145929    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:05.146817 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:05.146795    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:05.273584 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:05.273538    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:05.552868 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:51:05.552841    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ce822d_8a00_47de_948d_407a4f10856a.slice/crio-17303f6b2b3f2a7fb6ebafc786c15f657c80c2b78580f4adf429651408df3a80 WatchSource:0}: Error finding container 17303f6b2b3f2a7fb6ebafc786c15f657c80c2b78580f4adf429651408df3a80: Status 404 returned error can't find the container with id 17303f6b2b3f2a7fb6ebafc786c15f657c80c2b78580f4adf429651408df3a80
Sep 16 13:51:05.553056 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:05.553032    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"]
Sep 16 13:51:06.219000 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:06.218964    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" event={"ID":"50ce822d-8a00-47de-948d-407a4f10856a","Type":"ContainerStarted","Data":"74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3"}
Sep 16 13:51:06.219392 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:06.219013    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" event={"ID":"50ce822d-8a00-47de-948d-407a4f10856a","Type":"ContainerStarted","Data":"17303f6b2b3f2a7fb6ebafc786c15f657c80c2b78580f4adf429651408df3a80"}
Sep 16 13:51:06.219392 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:06.219054    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:06.243166 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:06.243116    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" podStartSLOduration=3.243099277 podStartE2EDuration="3.243099277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:06.242136092 +0000 UTC m=+1210.995826210" watchObservedRunningTime="2026-09-16 13:51:06.243099277 +0000 UTC m=+1210.996789399"
Sep 16 13:51:17.227613 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:17.227584    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:51:21.319965 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:21.319932    2552 generic.go:356] "Generic (PLEG): container finished" podID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerID="4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724" exitCode=0
Sep 16 13:51:21.320387 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:21.320002    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" event={"ID":"43c792cb-b867-4a1f-ae6c-47180b56e6fc","Type":"ContainerDied","Data":"4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"}
Sep 16 13:51:21.320440 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:21.320408    2552 scope.go:117] "RemoveContainer" containerID="4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"
Sep 16 13:51:21.321556 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:21.321523    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:51:21.321638 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:21.321624    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:51:21.321675 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:21.321662    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 13:51:22.329712 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.329675    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" event={"ID":"43c792cb-b867-4a1f-ae6c-47180b56e6fc","Type":"ContainerStarted","Data":"1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4"}
Sep 16 13:51:22.628984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.628905    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:51:22.629155 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.629132    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:51:22.629217 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.629196    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:51:22.924406 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.924322    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"]
Sep 16 13:51:22.928047 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.928026    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:22.931072 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.931049    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-8c36a6-dockercfg-pbntl\""
Sep 16 13:51:22.931185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.931109    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-8c36a6\""
Sep 16 13:51:22.944611 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.944590    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"]
Sep 16 13:51:22.951713 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.951692    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"]
Sep 16 13:51:22.951968 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.951922    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:22.970035 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:22.970000    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"]
Sep 16 13:51:23.029317 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.029290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3dbe10-5532-4fda-8e9d-52746bef7661-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.029317 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.029321    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sflg\" (UniqueName: \"kubernetes.io/projected/6558e0b9-4251-48bb-b3f6-3b955fe8d940-kube-api-access-9sflg\") pod \"payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.029515 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.029344    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg7sr\" (UniqueName: \"kubernetes.io/projected/da3dbe10-5532-4fda-8e9d-52746bef7661-kube-api-access-bg7sr\") pod \"payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.029515 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.029420    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6558e0b9-4251-48bb-b3f6-3b955fe8d940-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.130246 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.130207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6558e0b9-4251-48bb-b3f6-3b955fe8d940-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.130414 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.130389    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3dbe10-5532-4fda-8e9d-52746bef7661-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.130473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.130420    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sflg\" (UniqueName: \"kubernetes.io/projected/6558e0b9-4251-48bb-b3f6-3b955fe8d940-kube-api-access-9sflg\") pod \"payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.130473 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.130454    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7sr\" (UniqueName: \"kubernetes.io/projected/da3dbe10-5532-4fda-8e9d-52746bef7661-kube-api-access-bg7sr\") pod \"payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.130953 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.130927    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6558e0b9-4251-48bb-b3f6-3b955fe8d940-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.131164 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.131142    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3dbe10-5532-4fda-8e9d-52746bef7661-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.139030 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.139001    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg7sr\" (UniqueName: \"kubernetes.io/projected/da3dbe10-5532-4fda-8e9d-52746bef7661-kube-api-access-bg7sr\") pod \"payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.139133 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.139078    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sflg\" (UniqueName: \"kubernetes.io/projected/6558e0b9-4251-48bb-b3f6-3b955fe8d940-kube-api-access-9sflg\") pod \"payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.240041 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.239956    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:23.288226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.288193    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:23.537202 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.537181    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"]
Sep 16 13:51:23.538723 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:51:23.538701    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3dbe10_5532_4fda_8e9d_52746bef7661.slice/crio-0c3344da58c72c0ca861c1ab29b4c3d8a5c73c91b57490cb2c26c77e3b094b36 WatchSource:0}: Error finding container 0c3344da58c72c0ca861c1ab29b4c3d8a5c73c91b57490cb2c26c77e3b094b36: Status 404 returned error can't find the container with id 0c3344da58c72c0ca861c1ab29b4c3d8a5c73c91b57490cb2c26c77e3b094b36
Sep 16 13:51:23.606176 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.606149    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"]
Sep 16 13:51:23.611772 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:51:23.611724    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6558e0b9_4251_48bb_b3f6_3b955fe8d940.slice/crio-07d551146506edf5fea36657b7bd3eb89fdf07308bfc445efe7b6f68da3990bd WatchSource:0}: Error finding container 07d551146506edf5fea36657b7bd3eb89fdf07308bfc445efe7b6f68da3990bd: Status 404 returned error can't find the container with id 07d551146506edf5fea36657b7bd3eb89fdf07308bfc445efe7b6f68da3990bd
Sep 16 13:51:23.629160 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.629138    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:51:23.629267 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:23.629205    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:51:24.347038 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.347006    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw" event={"ID":"6558e0b9-4251-48bb-b3f6-3b955fe8d940","Type":"ContainerStarted","Data":"5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a"}
Sep 16 13:51:24.347304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.347282    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw" event={"ID":"6558e0b9-4251-48bb-b3f6-3b955fe8d940","Type":"ContainerStarted","Data":"07d551146506edf5fea36657b7bd3eb89fdf07308bfc445efe7b6f68da3990bd"}
Sep 16 13:51:24.347445 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.347432    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:24.349475 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.349444    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq" event={"ID":"da3dbe10-5532-4fda-8e9d-52746bef7661","Type":"ContainerStarted","Data":"728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533"}
Sep 16 13:51:24.350119 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.350099    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq" event={"ID":"da3dbe10-5532-4fda-8e9d-52746bef7661","Type":"ContainerStarted","Data":"0c3344da58c72c0ca861c1ab29b4c3d8a5c73c91b57490cb2c26c77e3b094b36"}
Sep 16 13:51:24.350312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.350297    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:24.369127 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.369063    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw" podStartSLOduration=2.369045586 podStartE2EDuration="2.369045586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:24.366833183 +0000 UTC m=+1229.120523305" watchObservedRunningTime="2026-09-16 13:51:24.369045586 +0000 UTC m=+1229.122735710"
Sep 16 13:51:24.387377 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.387339    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq" podStartSLOduration=2.387326136 podStartE2EDuration="2.387326136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:51:24.384995356 +0000 UTC m=+1229.138685479" watchObservedRunningTime="2026-09-16 13:51:24.387326136 +0000 UTC m=+1229.141016256"
Sep 16 13:51:24.629612 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.629497    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:51:24.629612 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:24.629575    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:51:25.629299 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:25.629262    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:51:25.629467 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:25.629332    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:51:26.629662 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:26.629629    2552 patch_prober.go:28] interesting pod/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:51:26.630001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:26.629696    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:51:27.632755 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:27.632719    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:51:27.633180 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:27.633001    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:51:27.633698 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:27.633682    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 13:51:36.371698 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:36.371669    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 13:51:36.372071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:36.371740    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 13:51:55.812721 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:51:55.812647    2552 scope.go:117] "RemoveContainer" containerID="6c7fe1f6cd90dbf52df3907931761f9bfaff3a2356740c26b92403f9f1b8af32"
Sep 16 13:52:31.852380 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.852344    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"]
Sep 16 13:52:31.856182 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.856163    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:31.858923 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.858894    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:52:31.864592 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.864521    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"]
Sep 16 13:52:31.876107 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.876066    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/588da833-892e-491e-a895-e615877c8f7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz\" (UID: \"588da833-892e-491e-a895-e615877c8f7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:31.977285 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.977255    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/588da833-892e-491e-a895-e615877c8f7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz\" (UID: \"588da833-892e-491e-a895-e615877c8f7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:31.977875 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:31.977856    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/588da833-892e-491e-a895-e615877c8f7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz\" (UID: \"588da833-892e-491e-a895-e615877c8f7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:32.169703 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:32.169632    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:32.451225 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:32.451201    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"]
Sep 16 13:52:32.452615 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:52:32.452579    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588da833_892e_491e_a895_e615877c8f7c.slice/crio-cdbe8f4cc56cab23e7979cdb0169240a2317db8d1737eeb6de693252bc63ab67 WatchSource:0}: Error finding container cdbe8f4cc56cab23e7979cdb0169240a2317db8d1737eeb6de693252bc63ab67: Status 404 returned error can't find the container with id cdbe8f4cc56cab23e7979cdb0169240a2317db8d1737eeb6de693252bc63ab67
Sep 16 13:52:32.766748 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:32.766723    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz" event={"ID":"588da833-892e-491e-a895-e615877c8f7c","Type":"ContainerStarted","Data":"fa2a80f2eea7cf665746fb0b2f09cca385c588c112c676cabce80c263ac235db"}
Sep 16 13:52:32.766866 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:32.766773    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz" event={"ID":"588da833-892e-491e-a895-e615877c8f7c","Type":"ContainerStarted","Data":"cdbe8f4cc56cab23e7979cdb0169240a2317db8d1737eeb6de693252bc63ab67"}
Sep 16 13:52:32.785938 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:32.785900    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz" podStartSLOduration=1.785885753 podStartE2EDuration="1.785885753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:52:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:52:32.783063447 +0000 UTC m=+1297.536753563" watchObservedRunningTime="2026-09-16 13:52:32.785885753 +0000 UTC m=+1297.539575893"
Sep 16 13:52:33.774347 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:33.774313    2552 generic.go:356] "Generic (PLEG): container finished" podID="588da833-892e-491e-a895-e615877c8f7c" containerID="fa2a80f2eea7cf665746fb0b2f09cca385c588c112c676cabce80c263ac235db" exitCode=0
Sep 16 13:52:33.774761 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:33.774374    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz" event={"ID":"588da833-892e-491e-a895-e615877c8f7c","Type":"ContainerDied","Data":"fa2a80f2eea7cf665746fb0b2f09cca385c588c112c676cabce80c263ac235db"}
Sep 16 13:52:34.913815 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:34.913785    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:35.005770 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:35.005740    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/588da833-892e-491e-a895-e615877c8f7c-maas-api-service-ca\") pod \"588da833-892e-491e-a895-e615877c8f7c\" (UID: \"588da833-892e-491e-a895-e615877c8f7c\") "
Sep 16 13:52:35.006080 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:35.006057    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/588da833-892e-491e-a895-e615877c8f7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "588da833-892e-491e-a895-e615877c8f7c" (UID: "588da833-892e-491e-a895-e615877c8f7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:52:35.106649 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:35.106563    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/588da833-892e-491e-a895-e615877c8f7c-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:52:35.787145 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:35.787105    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz" event={"ID":"588da833-892e-491e-a895-e615877c8f7c","Type":"ContainerDied","Data":"cdbe8f4cc56cab23e7979cdb0169240a2317db8d1737eeb6de693252bc63ab67"}
Sep 16 13:52:35.787145 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:35.787135    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"
Sep 16 13:52:35.787362 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:35.787166    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdbe8f4cc56cab23e7979cdb0169240a2317db8d1737eeb6de693252bc63ab67"
Sep 16 13:52:47.455165 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.455129    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"]
Sep 16 13:52:47.455728 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.455384    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" podUID="50ce822d-8a00-47de-948d-407a4f10856a" containerName="payload-pre-processing" containerID="cri-o://74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3" gracePeriod=30
Sep 16 13:52:47.631158 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.631099    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"]
Sep 16 13:52:47.637651 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.637607    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5dc2482-hvxlz"]
Sep 16 13:52:47.735727 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.735687    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:52:47.838854 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.838819    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="588da833-892e-491e-a895-e615877c8f7c" path="/var/lib/kubelet/pods/588da833-892e-491e-a895-e615877c8f7c/volumes"
Sep 16 13:52:47.844090 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.844059    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume\") pod \"50ce822d-8a00-47de-948d-407a4f10856a\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") "
Sep 16 13:52:47.844237 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.844115    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7jgn\" (UniqueName: \"kubernetes.io/projected/50ce822d-8a00-47de-948d-407a4f10856a-kube-api-access-n7jgn\") pod \"50ce822d-8a00-47de-948d-407a4f10856a\" (UID: \"50ce822d-8a00-47de-948d-407a4f10856a\") "
Sep 16 13:52:47.844482 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.844455    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50ce822d-8a00-47de-948d-407a4f10856a" (UID: "50ce822d-8a00-47de-948d-407a4f10856a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:52:47.846257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.846230    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ce822d-8a00-47de-948d-407a4f10856a-kube-api-access-n7jgn" (OuterVolumeSpecName: "kube-api-access-n7jgn") pod "50ce822d-8a00-47de-948d-407a4f10856a" (UID: "50ce822d-8a00-47de-948d-407a4f10856a"). InnerVolumeSpecName "kube-api-access-n7jgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:52:47.859130 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.859102    2552 generic.go:356] "Generic (PLEG): container finished" podID="50ce822d-8a00-47de-948d-407a4f10856a" containerID="74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3" exitCode=0
Sep 16 13:52:47.859231 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.859159    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"
Sep 16 13:52:47.859231 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.859187    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" event={"ID":"50ce822d-8a00-47de-948d-407a4f10856a","Type":"ContainerDied","Data":"74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3"}
Sep 16 13:52:47.859307 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.859239    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb" event={"ID":"50ce822d-8a00-47de-948d-407a4f10856a","Type":"ContainerDied","Data":"17303f6b2b3f2a7fb6ebafc786c15f657c80c2b78580f4adf429651408df3a80"}
Sep 16 13:52:47.859307 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.859262    2552 scope.go:117] "RemoveContainer" containerID="74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3"
Sep 16 13:52:47.868352 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.868333    2552 scope.go:117] "RemoveContainer" containerID="74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3"
Sep 16 13:52:47.868697 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:52:47.868675    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3\": container with ID starting with 74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3 not found: ID does not exist" containerID="74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3"
Sep 16 13:52:47.868794 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.868707    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3"} err="failed to get container status \"74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3\": rpc error: code = NotFound desc = could not find container \"74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3\": container with ID starting with 74974cfc0812a679f88f9ad0af8620a835ab4b1baf8e28a5103d8539de04b0d3 not found: ID does not exist"
Sep 16 13:52:47.887854 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.887833    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"]
Sep 16 13:52:47.894405 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.894385    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5dc2482-f6585cffd-t9fnb"]
Sep 16 13:52:47.945576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.945526    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ce822d-8a00-47de-948d-407a4f10856a-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:52:47.945576 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:47.945562    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7jgn\" (UniqueName: \"kubernetes.io/projected/50ce822d-8a00-47de-948d-407a4f10856a-kube-api-access-n7jgn\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:52:49.838953 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:49.838922    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ce822d-8a00-47de-948d-407a4f10856a" path="/var/lib/kubelet/pods/50ce822d-8a00-47de-948d-407a4f10856a/volumes"
Sep 16 13:52:55.836605 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:55.836567    2552 scope.go:117] "RemoveContainer" containerID="95dd3b8ca11a509bf46bb989d1bc9856343714d4e5c7a419c950d45b26b709b5"
Sep 16 13:52:55.846684 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:55.846656    2552 scope.go:117] "RemoveContainer" containerID="9a566d0dac6f1ee7fbd0316aed774b80dd264542e8c327a3d529a8d10c3bd105"
Sep 16 13:52:55.855862 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:52:55.855846    2552 scope.go:117] "RemoveContainer" containerID="94e44331a0b72576ac9a38c93238a89c0216e388726bcedd6c02878e67022945"
Sep 16 13:55:25.090455 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.090375    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"]
Sep 16 13:55:25.091243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.090880    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50ce822d-8a00-47de-948d-407a4f10856a" containerName="payload-pre-processing"
Sep 16 13:55:25.091243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.090894    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="50ce822d-8a00-47de-948d-407a4f10856a" containerName="payload-pre-processing"
Sep 16 13:55:25.091243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.090913    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="588da833-892e-491e-a895-e615877c8f7c" containerName="revoke-keys"
Sep 16 13:55:25.091243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.090921    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="588da833-892e-491e-a895-e615877c8f7c" containerName="revoke-keys"
Sep 16 13:55:25.091243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.090998    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="50ce822d-8a00-47de-948d-407a4f10856a" containerName="payload-pre-processing"
Sep 16 13:55:25.091243 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.091012    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="588da833-892e-491e-a895-e615877c8f7c" containerName="revoke-keys"
Sep 16 13:55:25.094298 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.094282    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.097331 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.097314    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bdd04e\""
Sep 16 13:55:25.104163 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.104140    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"]
Sep 16 13:55:25.113002 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.112981    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"]
Sep 16 13:55:25.117221 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.117203    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.119994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.119976    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bdd04e-dockercfg-n5c59\""
Sep 16 13:55:25.128526 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.128502    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"]
Sep 16 13:55:25.223153 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.223112    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5svw5\" (UniqueName: \"kubernetes.io/projected/92e770c2-6144-491f-8c78-ad6c5451afa4-kube-api-access-5svw5\") pod \"payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.223528 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.223503    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e79ad0-df7e-487c-bb7c-50656e64ffa0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") " pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.223752 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.223729    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92e770c2-6144-491f-8c78-ad6c5451afa4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.223938 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.223921    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gwft\" (UniqueName: \"kubernetes.io/projected/12e79ad0-df7e-487c-bb7c-50656e64ffa0-kube-api-access-4gwft\") pod \"payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") " pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.324994 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.324960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92e770c2-6144-491f-8c78-ad6c5451afa4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.325198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.325015    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gwft\" (UniqueName: \"kubernetes.io/projected/12e79ad0-df7e-487c-bb7c-50656e64ffa0-kube-api-access-4gwft\") pod \"payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") " pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.325198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.325169    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5svw5\" (UniqueName: \"kubernetes.io/projected/92e770c2-6144-491f-8c78-ad6c5451afa4-kube-api-access-5svw5\") pod \"payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.325198 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.325194    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e79ad0-df7e-487c-bb7c-50656e64ffa0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") " pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.325963 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.325940    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92e770c2-6144-491f-8c78-ad6c5451afa4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.326033 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.325973    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e79ad0-df7e-487c-bb7c-50656e64ffa0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") " pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.334252 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.334225    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5svw5\" (UniqueName: \"kubernetes.io/projected/92e770c2-6144-491f-8c78-ad6c5451afa4-kube-api-access-5svw5\") pod \"payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.334461 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.334441    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gwft\" (UniqueName: \"kubernetes.io/projected/12e79ad0-df7e-487c-bb7c-50656e64ffa0-kube-api-access-4gwft\") pod \"payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") " pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.406280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.406216    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:25.429425 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.429400    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:25.693064 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:55:25.693036    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e770c2_6144_491f_8c78_ad6c5451afa4.slice/crio-d62ce79b829ab278d02b855fad841f852a693c3f2f12570bc58dd32419d94c77 WatchSource:0}: Error finding container d62ce79b829ab278d02b855fad841f852a693c3f2f12570bc58dd32419d94c77: Status 404 returned error can't find the container with id d62ce79b829ab278d02b855fad841f852a693c3f2f12570bc58dd32419d94c77
Sep 16 13:55:25.693179 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.693123    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"]
Sep 16 13:55:25.723013 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.722994    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"]
Sep 16 13:55:25.728639 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:55:25.728618    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e79ad0_df7e_487c_bb7c_50656e64ffa0.slice/crio-a64044eb9935ce496b9d865c6298c6682bc9ec2df298767ae19f3ae504cd9a5a WatchSource:0}: Error finding container a64044eb9935ce496b9d865c6298c6682bc9ec2df298767ae19f3ae504cd9a5a: Status 404 returned error can't find the container with id a64044eb9935ce496b9d865c6298c6682bc9ec2df298767ae19f3ae504cd9a5a
Sep 16 13:55:25.758901 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.758870    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv" event={"ID":"92e770c2-6144-491f-8c78-ad6c5451afa4","Type":"ContainerStarted","Data":"d62ce79b829ab278d02b855fad841f852a693c3f2f12570bc58dd32419d94c77"}
Sep 16 13:55:25.760390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:25.760367    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk" event={"ID":"12e79ad0-df7e-487c-bb7c-50656e64ffa0","Type":"ContainerStarted","Data":"a64044eb9935ce496b9d865c6298c6682bc9ec2df298767ae19f3ae504cd9a5a"}
Sep 16 13:55:26.768053 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:26.768019    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv" event={"ID":"92e770c2-6144-491f-8c78-ad6c5451afa4","Type":"ContainerStarted","Data":"21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978"}
Sep 16 13:55:26.768496 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:26.768129    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:26.769733 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:26.769707    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk" event={"ID":"12e79ad0-df7e-487c-bb7c-50656e64ffa0","Type":"ContainerStarted","Data":"d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9"}
Sep 16 13:55:26.769855 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:26.769767    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:26.789255 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:26.789214    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv" podStartSLOduration=1.789202157 podStartE2EDuration="1.789202157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:55:26.786877663 +0000 UTC m=+1471.540567808" watchObservedRunningTime="2026-09-16 13:55:26.789202157 +0000 UTC m=+1471.542892278"
Sep 16 13:55:26.808168 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:26.808128    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk" podStartSLOduration=1.808117577 podStartE2EDuration="1.808117577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:55:26.806572407 +0000 UTC m=+1471.560262522" watchObservedRunningTime="2026-09-16 13:55:26.808117577 +0000 UTC m=+1471.561807698"
Sep 16 13:55:37.779585 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:37.779531    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:55:37.780511 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:37.780491    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:55:55.739222 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:55.739190    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:55:55.740656 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:55.740635    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 13:55:55.902536 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:55:55.902507    2552 scope.go:117] "RemoveContainer" containerID="66c9bfff0bc20b9605cab9b961ee7286425e155981e0f33b4efb4db0673791bc"
Sep 16 13:56:00.204383 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.204353    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"]
Sep 16 13:56:00.208345 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.208326    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.211421 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.211397    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-59a5a8\""
Sep 16 13:56:00.211421 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.211420    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-59a5a8-dockercfg-lzxwx\""
Sep 16 13:56:00.218257 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.218237    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"]
Sep 16 13:56:00.229200 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.229178    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"]
Sep 16 13:56:00.233655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.233639    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.244114 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.244088    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"]
Sep 16 13:56:00.262180 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.262154    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8da9e3ea-1127-47f7-8d12-e97749586af2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.262286 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.262197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2s6q\" (UniqueName: \"kubernetes.io/projected/8da9e3ea-1127-47f7-8d12-e97749586af2-kube-api-access-c2s6q\") pod \"payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.363206 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.363160    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b84tg\" (UniqueName: \"kubernetes.io/projected/f65f5679-f1b7-4cc5-94b1-75859861ebbc-kube-api-access-b84tg\") pod \"payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") " pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.363398 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.363273    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f65f5679-f1b7-4cc5-94b1-75859861ebbc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") " pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.363398 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.363319    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8da9e3ea-1127-47f7-8d12-e97749586af2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.363398 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.363349    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2s6q\" (UniqueName: \"kubernetes.io/projected/8da9e3ea-1127-47f7-8d12-e97749586af2-kube-api-access-c2s6q\") pod \"payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.364024 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.363997    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8da9e3ea-1127-47f7-8d12-e97749586af2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.371572 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.371520    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2s6q\" (UniqueName: \"kubernetes.io/projected/8da9e3ea-1127-47f7-8d12-e97749586af2-kube-api-access-c2s6q\") pod \"payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.464505 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.464424    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b84tg\" (UniqueName: \"kubernetes.io/projected/f65f5679-f1b7-4cc5-94b1-75859861ebbc-kube-api-access-b84tg\") pod \"payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") " pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.464681 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.464517    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f65f5679-f1b7-4cc5-94b1-75859861ebbc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") " pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.465251 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.465228    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f65f5679-f1b7-4cc5-94b1-75859861ebbc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") " pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.472822 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.472799    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b84tg\" (UniqueName: \"kubernetes.io/projected/f65f5679-f1b7-4cc5-94b1-75859861ebbc-kube-api-access-b84tg\") pod \"payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") " pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.521034 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.521015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.547564 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.546912    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.800735 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.800707    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"]
Sep 16 13:56:00.803622 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:56:00.803598    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da9e3ea_1127_47f7_8d12_e97749586af2.slice/crio-80c2e8eea840b2dec1f139e53bdd739518e35c045a6fd5847f1229d6ac5b03f8 WatchSource:0}: Error finding container 80c2e8eea840b2dec1f139e53bdd739518e35c045a6fd5847f1229d6ac5b03f8: Status 404 returned error can't find the container with id 80c2e8eea840b2dec1f139e53bdd739518e35c045a6fd5847f1229d6ac5b03f8
Sep 16 13:56:00.834582 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.834557    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"]
Sep 16 13:56:00.841657 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:56:00.841631    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65f5679_f1b7_4cc5_94b1_75859861ebbc.slice/crio-016ec28426babdebe9a0c99a4feed6d9554885db633ff00e60b95a5669c97f18 WatchSource:0}: Error finding container 016ec28426babdebe9a0c99a4feed6d9554885db633ff00e60b95a5669c97f18: Status 404 returned error can't find the container with id 016ec28426babdebe9a0c99a4feed6d9554885db633ff00e60b95a5669c97f18
Sep 16 13:56:00.974079 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.974039    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz" event={"ID":"f65f5679-f1b7-4cc5-94b1-75859861ebbc","Type":"ContainerStarted","Data":"bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d"}
Sep 16 13:56:00.974302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.974106    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz" event={"ID":"f65f5679-f1b7-4cc5-94b1-75859861ebbc","Type":"ContainerStarted","Data":"016ec28426babdebe9a0c99a4feed6d9554885db633ff00e60b95a5669c97f18"}
Sep 16 13:56:00.974302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.974254    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:00.975957 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.975927    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl" event={"ID":"8da9e3ea-1127-47f7-8d12-e97749586af2","Type":"ContainerStarted","Data":"4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2"}
Sep 16 13:56:00.976049 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.975976    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:00.976049 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.975994    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl" event={"ID":"8da9e3ea-1127-47f7-8d12-e97749586af2","Type":"ContainerStarted","Data":"80c2e8eea840b2dec1f139e53bdd739518e35c045a6fd5847f1229d6ac5b03f8"}
Sep 16 13:56:00.992484 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:00.992444    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz" podStartSLOduration=0.992429858 podStartE2EDuration="992.429858ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:56:00.991192799 +0000 UTC m=+1505.744882914" watchObservedRunningTime="2026-09-16 13:56:00.992429858 +0000 UTC m=+1505.746119982"
Sep 16 13:56:01.010997 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:01.010958    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl" podStartSLOduration=1.010945147 podStartE2EDuration="1.010945147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:56:01.008400202 +0000 UTC m=+1505.762090351" watchObservedRunningTime="2026-09-16 13:56:01.010945147 +0000 UTC m=+1505.764635268"
Sep 16 13:56:11.983945 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:11.983910    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:56:11.984306 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:11.983978    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:56:14.502578 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.502526    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"]
Sep 16 13:56:14.503177 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.503117    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5" podUID="6a357ba1-a024-4e96-9f7f-dd550d2421ba" containerName="payload-processing" containerID="cri-o://701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb" gracePeriod=30
Sep 16 13:56:14.760598 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.760577    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:56:14.906187 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.906148    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26tcz\" (UniqueName: \"kubernetes.io/projected/6a357ba1-a024-4e96-9f7f-dd550d2421ba-kube-api-access-26tcz\") pod \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") "
Sep 16 13:56:14.906356 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.906308    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a357ba1-a024-4e96-9f7f-dd550d2421ba-plugins-config-volume\") pod \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\" (UID: \"6a357ba1-a024-4e96-9f7f-dd550d2421ba\") "
Sep 16 13:56:14.906635 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.906613    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a357ba1-a024-4e96-9f7f-dd550d2421ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a357ba1-a024-4e96-9f7f-dd550d2421ba" (UID: "6a357ba1-a024-4e96-9f7f-dd550d2421ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:56:14.908276 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:14.908238    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a357ba1-a024-4e96-9f7f-dd550d2421ba-kube-api-access-26tcz" (OuterVolumeSpecName: "kube-api-access-26tcz") pod "6a357ba1-a024-4e96-9f7f-dd550d2421ba" (UID: "6a357ba1-a024-4e96-9f7f-dd550d2421ba"). InnerVolumeSpecName "kube-api-access-26tcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:56:15.007393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.007364    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a357ba1-a024-4e96-9f7f-dd550d2421ba-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:15.007393 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.007390    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26tcz\" (UniqueName: \"kubernetes.io/projected/6a357ba1-a024-4e96-9f7f-dd550d2421ba-kube-api-access-26tcz\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:15.063390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.063312    2552 generic.go:356] "Generic (PLEG): container finished" podID="6a357ba1-a024-4e96-9f7f-dd550d2421ba" containerID="701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb" exitCode=0
Sep 16 13:56:15.063390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.063359    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"
Sep 16 13:56:15.063534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.063407    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5" event={"ID":"6a357ba1-a024-4e96-9f7f-dd550d2421ba","Type":"ContainerDied","Data":"701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb"}
Sep 16 13:56:15.063534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.063469    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5" event={"ID":"6a357ba1-a024-4e96-9f7f-dd550d2421ba","Type":"ContainerDied","Data":"ab4312052cd214e2b6f64f706531dcfd924ded34d6af0ed7a7d766770a4971b5"}
Sep 16 13:56:15.063534 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.063499    2552 scope.go:117] "RemoveContainer" containerID="701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb"
Sep 16 13:56:15.073592 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.073573    2552 scope.go:117] "RemoveContainer" containerID="701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb"
Sep 16 13:56:15.073823 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:56:15.073805    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb\": container with ID starting with 701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb not found: ID does not exist" containerID="701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb"
Sep 16 13:56:15.073892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.073830    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb"} err="failed to get container status \"701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb\": rpc error: code = NotFound desc = could not find container \"701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb\": container with ID starting with 701fb0a14eff9dda97bc3177412d3ae9ecb554ffc28ead7227e83984ad8e2deb not found: ID does not exist"
Sep 16 13:56:15.092283 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.092256    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"]
Sep 16 13:56:15.094655 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.094625    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-46ccbd-6f9668d87f-664m5"]
Sep 16 13:56:15.839140 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:15.839110    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a357ba1-a024-4e96-9f7f-dd550d2421ba" path="/var/lib/kubelet/pods/6a357ba1-a024-4e96-9f7f-dd550d2421ba/volumes"
Sep 16 13:56:21.846023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:21.843856    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"]
Sep 16 13:56:21.846023 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:21.845663    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" containerID="cri-o://b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723" gracePeriod=30
Sep 16 13:56:26.105832 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:26.105794    2552 patch_prober.go:28] interesting pod/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 13:56:26.106313 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:26.105869    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:56:27.108190 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.108167    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:56:27.134408 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.134295    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvbb9\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-kube-api-access-zvbb9\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135113    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63816847-5ec3-4a5e-8475-09708f56c80d-istio-podinfo\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135167    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-data\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135206    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-envoy\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135280 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135256    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-credential-socket\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135288    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-socket\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135310    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-istio-token\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135369    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63816847-5ec3-4a5e-8475-09708f56c80d-istiod-ca-cert\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.135641 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.135459    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-certs\") pod \"63816847-5ec3-4a5e-8475-09708f56c80d\" (UID: \"63816847-5ec3-4a5e-8475-09708f56c80d\") "
Sep 16 13:56:27.136501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.136298    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:56:27.136501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.136312    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:56:27.136732 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.136521    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:56:27.137050 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.137025    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-data" (OuterVolumeSpecName: "istio-data") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:56:27.137192 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.137168    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63816847-5ec3-4a5e-8475-09708f56c80d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:56:27.137366 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.137322    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-kube-api-access-zvbb9" (OuterVolumeSpecName: "kube-api-access-zvbb9") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "kube-api-access-zvbb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:56:27.139296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.138894    2552 generic.go:356] "Generic (PLEG): container finished" podID="63816847-5ec3-4a5e-8475-09708f56c80d" containerID="b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723" exitCode=0
Sep 16 13:56:27.139296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.138970    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"
Sep 16 13:56:27.139296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.139084    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" event={"ID":"63816847-5ec3-4a5e-8475-09708f56c80d","Type":"ContainerDied","Data":"b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723"}
Sep 16 13:56:27.139296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.139133    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm" event={"ID":"63816847-5ec3-4a5e-8475-09708f56c80d","Type":"ContainerDied","Data":"f096f86ec82f643401067715e3fc1cb9c022a8c85f37e053989d6b2052f01497"}
Sep 16 13:56:27.139296 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.139162    2552 scope.go:117] "RemoveContainer" containerID="b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723"
Sep 16 13:56:27.139914 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.139302    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63816847-5ec3-4a5e-8475-09708f56c80d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:56:27.140124 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.140076    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-istio-token" (OuterVolumeSpecName: "istio-token") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:56:27.141053 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.141025    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63816847-5ec3-4a5e-8475-09708f56c80d" (UID: "63816847-5ec3-4a5e-8475-09708f56c80d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:56:27.166232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.166210    2552 scope.go:117] "RemoveContainer" containerID="e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"
Sep 16 13:56:27.176684 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.176653    2552 scope.go:117] "RemoveContainer" containerID="b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723"
Sep 16 13:56:27.177022 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:56:27.176945    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723\": container with ID starting with b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723 not found: ID does not exist" containerID="b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723"
Sep 16 13:56:27.177022 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.176986    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723"} err="failed to get container status \"b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723\": rpc error: code = NotFound desc = could not find container \"b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723\": container with ID starting with b170369fe98215eef4b4bfe97674151a6a3634effd1c3f65c18da1402daa3723 not found: ID does not exist"
Sep 16 13:56:27.177022 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.177014    2552 scope.go:117] "RemoveContainer" containerID="e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"
Sep 16 13:56:27.177342 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:56:27.177317    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f\": container with ID starting with e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f not found: ID does not exist" containerID="e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"
Sep 16 13:56:27.177444 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.177347    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f"} err="failed to get container status \"e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f\": rpc error: code = NotFound desc = could not find container \"e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f\": container with ID starting with e5a542337707fc413146d0791c2cea27d5b7e7bf460967588b20af6aa0574b4f not found: ID does not exist"
Sep 16 13:56:27.237185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237157    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237185 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237182    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237198    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63816847-5ec3-4a5e-8475-09708f56c80d-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237207    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237217    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvbb9\" (UniqueName: \"kubernetes.io/projected/63816847-5ec3-4a5e-8475-09708f56c80d-kube-api-access-zvbb9\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237226    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63816847-5ec3-4a5e-8475-09708f56c80d-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237234    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237243    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.237319 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.237250    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63816847-5ec3-4a5e-8475-09708f56c80d-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:27.462019 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.461987    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"]
Sep 16 13:56:27.465531 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.465502    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-46ccbd-openshift-default-78d6b96dc6-s7mqm"]
Sep 16 13:56:27.838796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:27.838766    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" path="/var/lib/kubelet/pods/63816847-5ec3-4a5e-8475-09708f56c80d/volumes"
Sep 16 13:56:42.888865 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:42.888824    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"]
Sep 16 13:56:42.889740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:42.889705    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk" podUID="12e79ad0-df7e-487c-bb7c-50656e64ffa0" containerName="payload-processing" containerID="cri-o://d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9" gracePeriod=30
Sep 16 13:56:42.900080 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:42.900049    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"]
Sep 16 13:56:42.900390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:42.900357    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv" podUID="92e770c2-6144-491f-8c78-ad6c5451afa4" containerName="payload-pre-processing" containerID="cri-o://21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978" gracePeriod=30
Sep 16 13:56:43.168137 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.168108    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:56:43.191193 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.191164    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:56:43.245132 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.245093    2552 generic.go:356] "Generic (PLEG): container finished" podID="12e79ad0-df7e-487c-bb7c-50656e64ffa0" containerID="d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9" exitCode=0
Sep 16 13:56:43.245341 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.245321    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk" event={"ID":"12e79ad0-df7e-487c-bb7c-50656e64ffa0","Type":"ContainerDied","Data":"d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9"}
Sep 16 13:56:43.245400 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.245379    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk" event={"ID":"12e79ad0-df7e-487c-bb7c-50656e64ffa0","Type":"ContainerDied","Data":"a64044eb9935ce496b9d865c6298c6682bc9ec2df298767ae19f3ae504cd9a5a"}
Sep 16 13:56:43.245439 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.245411    2552 scope.go:117] "RemoveContainer" containerID="d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9"
Sep 16 13:56:43.245640 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.245612    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"
Sep 16 13:56:43.248342 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.248276    2552 generic.go:356] "Generic (PLEG): container finished" podID="92e770c2-6144-491f-8c78-ad6c5451afa4" containerID="21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978" exitCode=0
Sep 16 13:56:43.248670 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.248539    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv" event={"ID":"92e770c2-6144-491f-8c78-ad6c5451afa4","Type":"ContainerDied","Data":"21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978"}
Sep 16 13:56:43.248797 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.248703    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv" event={"ID":"92e770c2-6144-491f-8c78-ad6c5451afa4","Type":"ContainerDied","Data":"d62ce79b829ab278d02b855fad841f852a693c3f2f12570bc58dd32419d94c77"}
Sep 16 13:56:43.248797 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.248776    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"
Sep 16 13:56:43.260812 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.260561    2552 scope.go:117] "RemoveContainer" containerID="d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9"
Sep 16 13:56:43.261322 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:56:43.261014    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9\": container with ID starting with d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9 not found: ID does not exist" containerID="d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9"
Sep 16 13:56:43.261322 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.261049    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9"} err="failed to get container status \"d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9\": rpc error: code = NotFound desc = could not find container \"d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9\": container with ID starting with d8228d8cb5bc72b6c51f4e1910c95289e3c48e09b2f1a4ec744765c7061625a9 not found: ID does not exist"
Sep 16 13:56:43.261322 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.261074    2552 scope.go:117] "RemoveContainer" containerID="21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978"
Sep 16 13:56:43.274889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.274654    2552 scope.go:117] "RemoveContainer" containerID="21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978"
Sep 16 13:56:43.275106 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:56:43.275079    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978\": container with ID starting with 21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978 not found: ID does not exist" containerID="21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978"
Sep 16 13:56:43.275350 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.275114    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978"} err="failed to get container status \"21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978\": rpc error: code = NotFound desc = could not find container \"21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978\": container with ID starting with 21f8f1ba826082e6e58c332ed36d155a00ad19cc60590b1f119b094a124d1978 not found: ID does not exist"
Sep 16 13:56:43.289616 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.289592    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5svw5\" (UniqueName: \"kubernetes.io/projected/92e770c2-6144-491f-8c78-ad6c5451afa4-kube-api-access-5svw5\") pod \"92e770c2-6144-491f-8c78-ad6c5451afa4\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") "
Sep 16 13:56:43.289705 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.289645    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92e770c2-6144-491f-8c78-ad6c5451afa4-plugins-config-volume\") pod \"92e770c2-6144-491f-8c78-ad6c5451afa4\" (UID: \"92e770c2-6144-491f-8c78-ad6c5451afa4\") "
Sep 16 13:56:43.289705 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.289671    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gwft\" (UniqueName: \"kubernetes.io/projected/12e79ad0-df7e-487c-bb7c-50656e64ffa0-kube-api-access-4gwft\") pod \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") "
Sep 16 13:56:43.289803 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.289726    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e79ad0-df7e-487c-bb7c-50656e64ffa0-plugins-config-volume\") pod \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\" (UID: \"12e79ad0-df7e-487c-bb7c-50656e64ffa0\") "
Sep 16 13:56:43.290136 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.290104    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e79ad0-df7e-487c-bb7c-50656e64ffa0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12e79ad0-df7e-487c-bb7c-50656e64ffa0" (UID: "12e79ad0-df7e-487c-bb7c-50656e64ffa0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:56:43.290221 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.290134    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92e770c2-6144-491f-8c78-ad6c5451afa4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92e770c2-6144-491f-8c78-ad6c5451afa4" (UID: "92e770c2-6144-491f-8c78-ad6c5451afa4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:56:43.291738 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.291715    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e770c2-6144-491f-8c78-ad6c5451afa4-kube-api-access-5svw5" (OuterVolumeSpecName: "kube-api-access-5svw5") pod "92e770c2-6144-491f-8c78-ad6c5451afa4" (UID: "92e770c2-6144-491f-8c78-ad6c5451afa4"). InnerVolumeSpecName "kube-api-access-5svw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:56:43.291821 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.291800    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e79ad0-df7e-487c-bb7c-50656e64ffa0-kube-api-access-4gwft" (OuterVolumeSpecName: "kube-api-access-4gwft") pod "12e79ad0-df7e-487c-bb7c-50656e64ffa0" (UID: "12e79ad0-df7e-487c-bb7c-50656e64ffa0"). InnerVolumeSpecName "kube-api-access-4gwft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:56:43.391634 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.391538    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5svw5\" (UniqueName: \"kubernetes.io/projected/92e770c2-6144-491f-8c78-ad6c5451afa4-kube-api-access-5svw5\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:43.391634 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.391587    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92e770c2-6144-491f-8c78-ad6c5451afa4-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:43.391634 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.391598    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gwft\" (UniqueName: \"kubernetes.io/projected/12e79ad0-df7e-487c-bb7c-50656e64ffa0-kube-api-access-4gwft\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:43.391634 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.391607    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e79ad0-df7e-487c-bb7c-50656e64ffa0-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:56:43.577304 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.577270    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"]
Sep 16 13:56:43.579612 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.579591    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bdd04e-6fd4477db9-wn8gk"]
Sep 16 13:56:43.594018 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.593993    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"]
Sep 16 13:56:43.602338 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.602316    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bdd04e-f6765d9bb-4kplv"]
Sep 16 13:56:43.838270 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.838237    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e79ad0-df7e-487c-bb7c-50656e64ffa0" path="/var/lib/kubelet/pods/12e79ad0-df7e-487c-bb7c-50656e64ffa0/volumes"
Sep 16 13:56:43.838670 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:43.838657    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92e770c2-6144-491f-8c78-ad6c5451afa4" path="/var/lib/kubelet/pods/92e770c2-6144-491f-8c78-ad6c5451afa4/volumes"
Sep 16 13:56:55.923001 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:56:55.922972    2552 scope.go:117] "RemoveContainer" containerID="e1ec45e2022c133ebd46c52b5bc723d2f19b26f16c2ee33b0672b817ccbd18cb"
Sep 16 13:57:11.061033 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.060998    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"]
Sep 16 13:57:11.061527 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.061255    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz" podUID="f65f5679-f1b7-4cc5-94b1-75859861ebbc" containerName="payload-processing" containerID="cri-o://bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d" gracePeriod=30
Sep 16 13:57:11.070630 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.070606    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"]
Sep 16 13:57:11.071691 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.071663    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl" podUID="8da9e3ea-1127-47f7-8d12-e97749586af2" containerName="payload-pre-processing" containerID="cri-o://4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2" gracePeriod=30
Sep 16 13:57:11.349244 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.349215    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:57:11.407258 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.407222    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:57:11.412510 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.412483    2552 generic.go:356] "Generic (PLEG): container finished" podID="f65f5679-f1b7-4cc5-94b1-75859861ebbc" containerID="bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d" exitCode=0
Sep 16 13:57:11.412692 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.412521    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"
Sep 16 13:57:11.412692 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.412576    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz" event={"ID":"f65f5679-f1b7-4cc5-94b1-75859861ebbc","Type":"ContainerDied","Data":"bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d"}
Sep 16 13:57:11.412692 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.412648    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz" event={"ID":"f65f5679-f1b7-4cc5-94b1-75859861ebbc","Type":"ContainerDied","Data":"016ec28426babdebe9a0c99a4feed6d9554885db633ff00e60b95a5669c97f18"}
Sep 16 13:57:11.412692 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.412666    2552 scope.go:117] "RemoveContainer" containerID="bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d"
Sep 16 13:57:11.413957 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.413934    2552 generic.go:356] "Generic (PLEG): container finished" podID="8da9e3ea-1127-47f7-8d12-e97749586af2" containerID="4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2" exitCode=0
Sep 16 13:57:11.414077 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.413971    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"
Sep 16 13:57:11.414077 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.414015    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl" event={"ID":"8da9e3ea-1127-47f7-8d12-e97749586af2","Type":"ContainerDied","Data":"4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2"}
Sep 16 13:57:11.414077 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.414065    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl" event={"ID":"8da9e3ea-1127-47f7-8d12-e97749586af2","Type":"ContainerDied","Data":"80c2e8eea840b2dec1f139e53bdd739518e35c045a6fd5847f1229d6ac5b03f8"}
Sep 16 13:57:11.422704 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.422687    2552 scope.go:117] "RemoveContainer" containerID="bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d"
Sep 16 13:57:11.422951 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:11.422932    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d\": container with ID starting with bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d not found: ID does not exist" containerID="bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d"
Sep 16 13:57:11.423005 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.422959    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d"} err="failed to get container status \"bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d\": rpc error: code = NotFound desc = could not find container \"bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d\": container with ID starting with bd2ab766047deaf70fd92daae546e1a4ed89a152978b8e2bc911a981344a777d not found: ID does not exist"
Sep 16 13:57:11.423005 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.422978    2552 scope.go:117] "RemoveContainer" containerID="4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2"
Sep 16 13:57:11.432722 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.432696    2552 scope.go:117] "RemoveContainer" containerID="4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2"
Sep 16 13:57:11.432988 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:11.432972    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2\": container with ID starting with 4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2 not found: ID does not exist" containerID="4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2"
Sep 16 13:57:11.433062 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.432994    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2"} err="failed to get container status \"4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2\": rpc error: code = NotFound desc = could not find container \"4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2\": container with ID starting with 4085957f19a840431ada2b1a0119e40588b76ebdf1e6629471e725e7b259d9a2 not found: ID does not exist"
Sep 16 13:57:11.460606 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.460583    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8da9e3ea-1127-47f7-8d12-e97749586af2-plugins-config-volume\") pod \"8da9e3ea-1127-47f7-8d12-e97749586af2\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") "
Sep 16 13:57:11.460723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.460619    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f65f5679-f1b7-4cc5-94b1-75859861ebbc-plugins-config-volume\") pod \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") "
Sep 16 13:57:11.460723 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.460671    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b84tg\" (UniqueName: \"kubernetes.io/projected/f65f5679-f1b7-4cc5-94b1-75859861ebbc-kube-api-access-b84tg\") pod \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\" (UID: \"f65f5679-f1b7-4cc5-94b1-75859861ebbc\") "
Sep 16 13:57:11.460846 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.460833    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2s6q\" (UniqueName: \"kubernetes.io/projected/8da9e3ea-1127-47f7-8d12-e97749586af2-kube-api-access-c2s6q\") pod \"8da9e3ea-1127-47f7-8d12-e97749586af2\" (UID: \"8da9e3ea-1127-47f7-8d12-e97749586af2\") "
Sep 16 13:57:11.461102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.461042    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65f5679-f1b7-4cc5-94b1-75859861ebbc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f65f5679-f1b7-4cc5-94b1-75859861ebbc" (UID: "f65f5679-f1b7-4cc5-94b1-75859861ebbc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:11.461102 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.461060    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da9e3ea-1127-47f7-8d12-e97749586af2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8da9e3ea-1127-47f7-8d12-e97749586af2" (UID: "8da9e3ea-1127-47f7-8d12-e97749586af2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:11.461312 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.461294    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8da9e3ea-1127-47f7-8d12-e97749586af2-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:11.461366 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.461317    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f65f5679-f1b7-4cc5-94b1-75859861ebbc-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:11.462816 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.462795    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65f5679-f1b7-4cc5-94b1-75859861ebbc-kube-api-access-b84tg" (OuterVolumeSpecName: "kube-api-access-b84tg") pod "f65f5679-f1b7-4cc5-94b1-75859861ebbc" (UID: "f65f5679-f1b7-4cc5-94b1-75859861ebbc"). InnerVolumeSpecName "kube-api-access-b84tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:11.462889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.462840    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da9e3ea-1127-47f7-8d12-e97749586af2-kube-api-access-c2s6q" (OuterVolumeSpecName: "kube-api-access-c2s6q") pod "8da9e3ea-1127-47f7-8d12-e97749586af2" (UID: "8da9e3ea-1127-47f7-8d12-e97749586af2"). InnerVolumeSpecName "kube-api-access-c2s6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:11.561977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.561946    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2s6q\" (UniqueName: \"kubernetes.io/projected/8da9e3ea-1127-47f7-8d12-e97749586af2-kube-api-access-c2s6q\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:11.561977 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.561972    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b84tg\" (UniqueName: \"kubernetes.io/projected/f65f5679-f1b7-4cc5-94b1-75859861ebbc-kube-api-access-b84tg\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:11.740733 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.740704    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"]
Sep 16 13:57:11.746870 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.746848    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-59a5a8-648884dcd6-wr7rl"]
Sep 16 13:57:11.758196 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.758163    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"]
Sep 16 13:57:11.764743 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.764720    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-59a5a8-5db55c98c-9ftkz"]
Sep 16 13:57:11.839098 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.839064    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da9e3ea-1127-47f7-8d12-e97749586af2" path="/var/lib/kubelet/pods/8da9e3ea-1127-47f7-8d12-e97749586af2/volumes"
Sep 16 13:57:11.839449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:11.839436    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65f5679-f1b7-4cc5-94b1-75859861ebbc" path="/var/lib/kubelet/pods/f65f5679-f1b7-4cc5-94b1-75859861ebbc/volumes"
Sep 16 13:57:12.508789 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.508745    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"]
Sep 16 13:57:12.510989 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.510960    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4bb29c-29826105-brggs"]
Sep 16 13:57:12.532566 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.532527    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"]
Sep 16 13:57:12.532830 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.532801    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f" podUID="bebb33fb-fae7-4b13-80c8-b2b6e2f29962" containerName="payload-processing" containerID="cri-o://f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e" gracePeriod=30
Sep 16 13:57:12.544781 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.544757    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"]
Sep 16 13:57:12.546192 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.545424    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8" podUID="edad014c-8817-41e0-b03b-b7462abc78b1" containerName="payload-pre-processing" containerID="cri-o://da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44" gracePeriod=30
Sep 16 13:57:12.847771 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.847742    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:57:12.849822 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.849802    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:57:12.875740 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.875717    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnkvr\" (UniqueName: \"kubernetes.io/projected/edad014c-8817-41e0-b03b-b7462abc78b1-kube-api-access-tnkvr\") pod \"edad014c-8817-41e0-b03b-b7462abc78b1\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") "
Sep 16 13:57:12.875896 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.875772    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edad014c-8817-41e0-b03b-b7462abc78b1-plugins-config-volume\") pod \"edad014c-8817-41e0-b03b-b7462abc78b1\" (UID: \"edad014c-8817-41e0-b03b-b7462abc78b1\") "
Sep 16 13:57:12.875896 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.875828    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-plugins-config-volume\") pod \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") "
Sep 16 13:57:12.875896 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.875857    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4b5k\" (UniqueName: \"kubernetes.io/projected/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-kube-api-access-r4b5k\") pod \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\" (UID: \"bebb33fb-fae7-4b13-80c8-b2b6e2f29962\") "
Sep 16 13:57:12.876302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.876208    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edad014c-8817-41e0-b03b-b7462abc78b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "edad014c-8817-41e0-b03b-b7462abc78b1" (UID: "edad014c-8817-41e0-b03b-b7462abc78b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:12.876302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.876248    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bebb33fb-fae7-4b13-80c8-b2b6e2f29962" (UID: "bebb33fb-fae7-4b13-80c8-b2b6e2f29962"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:12.876302 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.876274    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edad014c-8817-41e0-b03b-b7462abc78b1-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:12.878226 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.878196    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-kube-api-access-r4b5k" (OuterVolumeSpecName: "kube-api-access-r4b5k") pod "bebb33fb-fae7-4b13-80c8-b2b6e2f29962" (UID: "bebb33fb-fae7-4b13-80c8-b2b6e2f29962"). InnerVolumeSpecName "kube-api-access-r4b5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:12.878402 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.878382    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edad014c-8817-41e0-b03b-b7462abc78b1-kube-api-access-tnkvr" (OuterVolumeSpecName: "kube-api-access-tnkvr") pod "edad014c-8817-41e0-b03b-b7462abc78b1" (UID: "edad014c-8817-41e0-b03b-b7462abc78b1"). InnerVolumeSpecName "kube-api-access-tnkvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:12.976976 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.976946    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:12.976976 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.976975    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4b5k\" (UniqueName: \"kubernetes.io/projected/bebb33fb-fae7-4b13-80c8-b2b6e2f29962-kube-api-access-r4b5k\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:12.976976 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:12.976987    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnkvr\" (UniqueName: \"kubernetes.io/projected/edad014c-8817-41e0-b03b-b7462abc78b1-kube-api-access-tnkvr\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:13.429301 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.429207    2552 generic.go:356] "Generic (PLEG): container finished" podID="bebb33fb-fae7-4b13-80c8-b2b6e2f29962" containerID="f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e" exitCode=0
Sep 16 13:57:13.429301 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.429261    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"
Sep 16 13:57:13.429301 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.429261    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f" event={"ID":"bebb33fb-fae7-4b13-80c8-b2b6e2f29962","Type":"ContainerDied","Data":"f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e"}
Sep 16 13:57:13.429608 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.429334    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f" event={"ID":"bebb33fb-fae7-4b13-80c8-b2b6e2f29962","Type":"ContainerDied","Data":"44faf12ca3a59d9fa72d743ee9a589756008f953d7346e1357584e9ffeace104"}
Sep 16 13:57:13.429608 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.429365    2552 scope.go:117] "RemoveContainer" containerID="f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e"
Sep 16 13:57:13.430750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.430729    2552 generic.go:356] "Generic (PLEG): container finished" podID="edad014c-8817-41e0-b03b-b7462abc78b1" containerID="da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44" exitCode=0
Sep 16 13:57:13.430868 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.430782    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"
Sep 16 13:57:13.430868 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.430815    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8" event={"ID":"edad014c-8817-41e0-b03b-b7462abc78b1","Type":"ContainerDied","Data":"da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44"}
Sep 16 13:57:13.430868 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.430863    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8" event={"ID":"edad014c-8817-41e0-b03b-b7462abc78b1","Type":"ContainerDied","Data":"535934362e5c58e0442ee266c8146276705def1e178dca7c733d4f673778471f"}
Sep 16 13:57:13.442189 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.442171    2552 scope.go:117] "RemoveContainer" containerID="f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e"
Sep 16 13:57:13.442720 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:13.442536    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e\": container with ID starting with f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e not found: ID does not exist" containerID="f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e"
Sep 16 13:57:13.442720 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.442594    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e"} err="failed to get container status \"f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e\": rpc error: code = NotFound desc = could not find container \"f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e\": container with ID starting with f27ec8c3715977178aa68602527ae373e62cd00f9d0ee21e5813c16cc51d831e not found: ID does not exist"
Sep 16 13:57:13.442720 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.442618    2552 scope.go:117] "RemoveContainer" containerID="da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44"
Sep 16 13:57:13.450877 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.450867    2552 scope.go:117] "RemoveContainer" containerID="da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44"
Sep 16 13:57:13.451146 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:13.451129    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44\": container with ID starting with da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44 not found: ID does not exist" containerID="da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44"
Sep 16 13:57:13.451209 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.451154    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44"} err="failed to get container status \"da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44\": rpc error: code = NotFound desc = could not find container \"da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44\": container with ID starting with da9db6b657607a510604a41ae6085f1307ca094c84f63a58b3c5f0d73d7acf44 not found: ID does not exist"
Sep 16 13:57:13.466267 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.466243    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"]
Sep 16 13:57:13.468436 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.468413    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4bb29c-595c45d8c9-wss6f"]
Sep 16 13:57:13.486439 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.486417    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"]
Sep 16 13:57:13.491292 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.491274    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4bb29c-777c44f4c4-gpgm8"]
Sep 16 13:57:13.839079 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.839044    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e59baba-8585-43f1-87d6-022acfb831ba" path="/var/lib/kubelet/pods/9e59baba-8585-43f1-87d6-022acfb831ba/volumes"
Sep 16 13:57:13.839477 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.839381    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebb33fb-fae7-4b13-80c8-b2b6e2f29962" path="/var/lib/kubelet/pods/bebb33fb-fae7-4b13-80c8-b2b6e2f29962/volumes"
Sep 16 13:57:13.839716 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:13.839702    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edad014c-8817-41e0-b03b-b7462abc78b1" path="/var/lib/kubelet/pods/edad014c-8817-41e0-b03b-b7462abc78b1/volumes"
Sep 16 13:57:18.277090 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277054    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"]
Sep 16 13:57:18.277753 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277732    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy"
Sep 16 13:57:18.277819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277757    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy"
Sep 16 13:57:18.277819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277787    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a357ba1-a024-4e96-9f7f-dd550d2421ba" containerName="payload-processing"
Sep 16 13:57:18.277819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277796    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a357ba1-a024-4e96-9f7f-dd550d2421ba" containerName="payload-processing"
Sep 16 13:57:18.277819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277807    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edad014c-8817-41e0-b03b-b7462abc78b1" containerName="payload-pre-processing"
Sep 16 13:57:18.277819 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277816    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="edad014c-8817-41e0-b03b-b7462abc78b1" containerName="payload-pre-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277825    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277834    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277852    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e770c2-6144-491f-8c78-ad6c5451afa4" containerName="payload-pre-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277860    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e770c2-6144-491f-8c78-ad6c5451afa4" containerName="payload-pre-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277870    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e79ad0-df7e-487c-bb7c-50656e64ffa0" containerName="payload-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277880    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e79ad0-df7e-487c-bb7c-50656e64ffa0" containerName="payload-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277894    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebb33fb-fae7-4b13-80c8-b2b6e2f29962" containerName="payload-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277902    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebb33fb-fae7-4b13-80c8-b2b6e2f29962" containerName="payload-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277923    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65f5679-f1b7-4cc5-94b1-75859861ebbc" containerName="payload-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277931    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65f5679-f1b7-4cc5-94b1-75859861ebbc" containerName="payload-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277944    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da9e3ea-1127-47f7-8d12-e97749586af2" containerName="payload-pre-processing"
Sep 16 13:57:18.277984 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.277952    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da9e3ea-1127-47f7-8d12-e97749586af2" containerName="payload-pre-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278062    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e770c2-6144-491f-8c78-ad6c5451afa4" containerName="payload-pre-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278074    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278085    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="edad014c-8817-41e0-b03b-b7462abc78b1" containerName="payload-pre-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278096    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e79ad0-df7e-487c-bb7c-50656e64ffa0" containerName="payload-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278105    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebb33fb-fae7-4b13-80c8-b2b6e2f29962" containerName="payload-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278113    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da9e3ea-1127-47f7-8d12-e97749586af2" containerName="payload-pre-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278131    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f65f5679-f1b7-4cc5-94b1-75859861ebbc" containerName="payload-processing"
Sep 16 13:57:18.278351 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.278139    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a357ba1-a024-4e96-9f7f-dd550d2421ba" containerName="payload-processing"
Sep 16 13:57:18.282694 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.282674    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:18.286390 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.286373    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 13:57:18.287359 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.287336    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"]
Sep 16 13:57:18.326134 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.326098    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8593acf-741d-4743-87fc-2e9370265503-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t\" (UID: \"c8593acf-741d-4743-87fc-2e9370265503\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:18.427138 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.427111    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8593acf-741d-4743-87fc-2e9370265503-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t\" (UID: \"c8593acf-741d-4743-87fc-2e9370265503\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:18.427729 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.427709    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8593acf-741d-4743-87fc-2e9370265503-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t\" (UID: \"c8593acf-741d-4743-87fc-2e9370265503\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:18.596417 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.596340    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:18.870898 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:18.870875    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"]
Sep 16 13:57:18.873595 ip-10-0-129-205 kubenswrapper[2552]: W0916 13:57:18.873561    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8593acf_741d_4743_87fc_2e9370265503.slice/crio-dcdb106c0e69a8be52c16a778b4cdbca28bf767a7f7560ed7b6342d5573c27d2 WatchSource:0}: Error finding container dcdb106c0e69a8be52c16a778b4cdbca28bf767a7f7560ed7b6342d5573c27d2: Status 404 returned error can't find the container with id dcdb106c0e69a8be52c16a778b4cdbca28bf767a7f7560ed7b6342d5573c27d2
Sep 16 13:57:19.469232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:19.469155    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t" event={"ID":"c8593acf-741d-4743-87fc-2e9370265503","Type":"ContainerStarted","Data":"f687ddf351f495df34336fbfb2a3b58b7d12d15c7b0761ad24a3308432ffac25"}
Sep 16 13:57:19.469232 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:19.469205    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t" event={"ID":"c8593acf-741d-4743-87fc-2e9370265503","Type":"ContainerStarted","Data":"dcdb106c0e69a8be52c16a778b4cdbca28bf767a7f7560ed7b6342d5573c27d2"}
Sep 16 13:57:19.486935 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:19.486888    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t" podStartSLOduration=1.486872927 podStartE2EDuration="1.486872927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:57:19.485222999 +0000 UTC m=+1584.238913135" watchObservedRunningTime="2026-09-16 13:57:19.486872927 +0000 UTC m=+1584.240563047"
Sep 16 13:57:20.477925 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:20.477885    2552 generic.go:356] "Generic (PLEG): container finished" podID="c8593acf-741d-4743-87fc-2e9370265503" containerID="f687ddf351f495df34336fbfb2a3b58b7d12d15c7b0761ad24a3308432ffac25" exitCode=0
Sep 16 13:57:20.478356 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:20.477949    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t" event={"ID":"c8593acf-741d-4743-87fc-2e9370265503","Type":"ContainerDied","Data":"f687ddf351f495df34336fbfb2a3b58b7d12d15c7b0761ad24a3308432ffac25"}
Sep 16 13:57:21.624052 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:21.624027    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:21.757144 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:21.757108    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8593acf-741d-4743-87fc-2e9370265503-maas-api-service-ca\") pod \"c8593acf-741d-4743-87fc-2e9370265503\" (UID: \"c8593acf-741d-4743-87fc-2e9370265503\") "
Sep 16 13:57:21.757449 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:21.757426    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8593acf-741d-4743-87fc-2e9370265503-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8593acf-741d-4743-87fc-2e9370265503" (UID: "c8593acf-741d-4743-87fc-2e9370265503"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:21.757564 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:21.757502    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8593acf-741d-4743-87fc-2e9370265503-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:22.490816 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:22.490780    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t" event={"ID":"c8593acf-741d-4743-87fc-2e9370265503","Type":"ContainerDied","Data":"dcdb106c0e69a8be52c16a778b4cdbca28bf767a7f7560ed7b6342d5573c27d2"}
Sep 16 13:57:22.490962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:22.490858    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcdb106c0e69a8be52c16a778b4cdbca28bf767a7f7560ed7b6342d5573c27d2"
Sep 16 13:57:22.490962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:22.490791    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"
Sep 16 13:57:28.774980 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:28.774946    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"]
Sep 16 13:57:28.775796 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:28.775739    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f" podUID="0e79e659-a29a-46fd-974c-9cefb2597724" containerName="payload-processing" containerID="cri-o://c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b" gracePeriod=30
Sep 16 13:57:28.783857 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:28.783829    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"]
Sep 16 13:57:28.784064 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:28.784040    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd" podUID="4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" containerName="payload-pre-processing" containerID="cri-o://6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d" gracePeriod=30
Sep 16 13:57:28.944378 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:28.944341    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"]
Sep 16 13:57:28.948667 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:28.948646    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-aff7af-82t4t"]
Sep 16 13:57:29.071696 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.071670    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:57:29.089620 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.089599    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:57:29.132954 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.132916    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db9wm\" (UniqueName: \"kubernetes.io/projected/0e79e659-a29a-46fd-974c-9cefb2597724-kube-api-access-db9wm\") pod \"0e79e659-a29a-46fd-974c-9cefb2597724\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") "
Sep 16 13:57:29.133136 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.133055    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e79e659-a29a-46fd-974c-9cefb2597724-plugins-config-volume\") pod \"0e79e659-a29a-46fd-974c-9cefb2597724\" (UID: \"0e79e659-a29a-46fd-974c-9cefb2597724\") "
Sep 16 13:57:29.138386 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.137948    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e79e659-a29a-46fd-974c-9cefb2597724-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e79e659-a29a-46fd-974c-9cefb2597724" (UID: "0e79e659-a29a-46fd-974c-9cefb2597724"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:29.140910 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.140881    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e79e659-a29a-46fd-974c-9cefb2597724-kube-api-access-db9wm" (OuterVolumeSpecName: "kube-api-access-db9wm") pod "0e79e659-a29a-46fd-974c-9cefb2597724" (UID: "0e79e659-a29a-46fd-974c-9cefb2597724"). InnerVolumeSpecName "kube-api-access-db9wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:29.234356 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.234321    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-plugins-config-volume\") pod \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") "
Sep 16 13:57:29.234500 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.234461    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8vgh\" (UniqueName: \"kubernetes.io/projected/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-kube-api-access-x8vgh\") pod \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\" (UID: \"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418\") "
Sep 16 13:57:29.234686 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.234665    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" (UID: "4cded68a-0a5b-4f8d-abf8-dd9bd44b3418"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:29.234784 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.234769    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:29.234835 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.234786    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e79e659-a29a-46fd-974c-9cefb2597724-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:29.234835 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.234794    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db9wm\" (UniqueName: \"kubernetes.io/projected/0e79e659-a29a-46fd-974c-9cefb2597724-kube-api-access-db9wm\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:29.236537 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.236515    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-kube-api-access-x8vgh" (OuterVolumeSpecName: "kube-api-access-x8vgh") pod "4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" (UID: "4cded68a-0a5b-4f8d-abf8-dd9bd44b3418"). InnerVolumeSpecName "kube-api-access-x8vgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:29.336262 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.336178    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8vgh\" (UniqueName: \"kubernetes.io/projected/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418-kube-api-access-x8vgh\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:29.533230 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.533197    2552 generic.go:356] "Generic (PLEG): container finished" podID="4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" containerID="6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d" exitCode=0
Sep 16 13:57:29.533422 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.533248    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"
Sep 16 13:57:29.533422 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.533270    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd" event={"ID":"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418","Type":"ContainerDied","Data":"6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d"}
Sep 16 13:57:29.533422 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.533316    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd" event={"ID":"4cded68a-0a5b-4f8d-abf8-dd9bd44b3418","Type":"ContainerDied","Data":"65d90319fb78fa49c2223c01e5ffd78ef8304f5d41521b0463f03c16ee0f209a"}
Sep 16 13:57:29.533422 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.533340    2552 scope.go:117] "RemoveContainer" containerID="6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d"
Sep 16 13:57:29.534687 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.534660    2552 generic.go:356] "Generic (PLEG): container finished" podID="0e79e659-a29a-46fd-974c-9cefb2597724" containerID="c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b" exitCode=0
Sep 16 13:57:29.534889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.534707    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"
Sep 16 13:57:29.534889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.534737    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f" event={"ID":"0e79e659-a29a-46fd-974c-9cefb2597724","Type":"ContainerDied","Data":"c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b"}
Sep 16 13:57:29.534889 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.534789    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f" event={"ID":"0e79e659-a29a-46fd-974c-9cefb2597724","Type":"ContainerDied","Data":"f506288f5e2a26b80f9fec3497d047123011e9115d537ec245410d03853fcf46"}
Sep 16 13:57:29.545781 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.545407    2552 scope.go:117] "RemoveContainer" containerID="6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d"
Sep 16 13:57:29.546321 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:29.546151    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d\": container with ID starting with 6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d not found: ID does not exist" containerID="6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d"
Sep 16 13:57:29.546321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.546188    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d"} err="failed to get container status \"6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d\": rpc error: code = NotFound desc = could not find container \"6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d\": container with ID starting with 6c4ee6f553ba7ec4c201fa3815fa95fc79aaf00f13a5effd15b1ca74f4f01e7d not found: ID does not exist"
Sep 16 13:57:29.546321 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.546213    2552 scope.go:117] "RemoveContainer" containerID="c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b"
Sep 16 13:57:29.559040 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.559021    2552 scope.go:117] "RemoveContainer" containerID="c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b"
Sep 16 13:57:29.559480 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:29.559464    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b\": container with ID starting with c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b not found: ID does not exist" containerID="c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b"
Sep 16 13:57:29.559572 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.559486    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b"} err="failed to get container status \"c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b\": rpc error: code = NotFound desc = could not find container \"c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b\": container with ID starting with c9ce8be041af8c6cde67b00e4b7aa05f0e016939a7a4d81d9799df8182cdff6b not found: ID does not exist"
Sep 16 13:57:29.564331 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.564309    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"]
Sep 16 13:57:29.568017 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.568000    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-aff7af-654ccb774b-p7cqd"]
Sep 16 13:57:29.579241 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.579221    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"]
Sep 16 13:57:29.583410 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.583391    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-aff7af-56f9b97967-sw29f"]
Sep 16 13:57:29.838711 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.838681    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e79e659-a29a-46fd-974c-9cefb2597724" path="/var/lib/kubelet/pods/0e79e659-a29a-46fd-974c-9cefb2597724/volumes"
Sep 16 13:57:29.839045 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.839032    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" path="/var/lib/kubelet/pods/4cded68a-0a5b-4f8d-abf8-dd9bd44b3418/volumes"
Sep 16 13:57:29.839320 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:29.839309    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8593acf-741d-4743-87fc-2e9370265503" path="/var/lib/kubelet/pods/c8593acf-741d-4743-87fc-2e9370265503/volumes"
Sep 16 13:57:36.182222 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:36.182191    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"]
Sep 16 13:57:36.182622 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:36.182385    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy" containerID="cri-o://adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100" gracePeriod=30
Sep 16 13:57:41.437762 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.437736    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:57:41.548942 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.548905    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m52h5\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-kube-api-access-m52h5\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549125 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549015    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-credential-socket\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549125 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549065    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52658e31-b412-42b9-8367-f2f7b43b762f-istiod-ca-cert\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549234 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549191    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-data\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549300 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549224    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-socket\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549300 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549276    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-istio-token\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549430 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549394    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-certs\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549441    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52658e31-b412-42b9-8367-f2f7b43b762f-istio-podinfo\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549504 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549469    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-envoy\") pod \"52658e31-b412-42b9-8367-f2f7b43b762f\" (UID: \"52658e31-b412-42b9-8367-f2f7b43b762f\") "
Sep 16 13:57:41.549635 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549599    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:57:41.550148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549835    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-data" (OuterVolumeSpecName: "istio-data") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:57:41.550148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.549985    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.550148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.550009    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.550148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.550005    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:57:41.550148 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.550107    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52658e31-b412-42b9-8367-f2f7b43b762f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:41.550743 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.550247    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:57:41.553800 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.552704    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-kube-api-access-m52h5" (OuterVolumeSpecName: "kube-api-access-m52h5") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "kube-api-access-m52h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:41.553800 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.553191    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:57:41.553800 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.553649    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-istio-token" (OuterVolumeSpecName: "istio-token") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:41.553800 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.553768    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52658e31-b412-42b9-8367-f2f7b43b762f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52658e31-b412-42b9-8367-f2f7b43b762f" (UID: "52658e31-b412-42b9-8367-f2f7b43b762f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:57:41.615528 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.615500    2552 generic.go:356] "Generic (PLEG): container finished" podID="52658e31-b412-42b9-8367-f2f7b43b762f" containerID="adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100" exitCode=0
Sep 16 13:57:41.615658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.615538    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" event={"ID":"52658e31-b412-42b9-8367-f2f7b43b762f","Type":"ContainerDied","Data":"adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100"}
Sep 16 13:57:41.615658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.615566    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"
Sep 16 13:57:41.615658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.615612    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd" event={"ID":"52658e31-b412-42b9-8367-f2f7b43b762f","Type":"ContainerDied","Data":"c840d6bc565552af0eb2eefa47efe3b0f2bb761025185f2c5df58c51e10abc33"}
Sep 16 13:57:41.615658 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.615641    2552 scope.go:117] "RemoveContainer" containerID="adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100"
Sep 16 13:57:41.629642 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.629613    2552 scope.go:117] "RemoveContainer" containerID="51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"
Sep 16 13:57:41.643886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.643201    2552 scope.go:117] "RemoveContainer" containerID="adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100"
Sep 16 13:57:41.643886 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:41.643538    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100\": container with ID starting with adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100 not found: ID does not exist" containerID="adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100"
Sep 16 13:57:41.643886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.643591    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100"} err="failed to get container status \"adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100\": rpc error: code = NotFound desc = could not find container \"adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100\": container with ID starting with adbb14e8e24ffa038d56d6f46a38dd46c3b89bc1330157bbc75f3084d01f1100 not found: ID does not exist"
Sep 16 13:57:41.643886 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.643617    2552 scope.go:117] "RemoveContainer" containerID="51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"
Sep 16 13:57:41.644763 ip-10-0-129-205 kubenswrapper[2552]: E0916 13:57:41.644508    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168\": container with ID starting with 51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168 not found: ID does not exist" containerID="51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"
Sep 16 13:57:41.644763 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.644575    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168"} err="failed to get container status \"51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168\": rpc error: code = NotFound desc = could not find container \"51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168\": container with ID starting with 51433cb4e69957e5a051d5204f1521e55701ebc2935276a7122147561ca27168 not found: ID does not exist"
Sep 16 13:57:41.644763 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.647365    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"]
Sep 16 13:57:41.651493 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651470    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.651623 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651597    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.651623 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651615    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52658e31-b412-42b9-8367-f2f7b43b762f-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.651750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651627    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.651750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651642    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m52h5\" (UniqueName: \"kubernetes.io/projected/52658e31-b412-42b9-8367-f2f7b43b762f-kube-api-access-m52h5\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.651750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651659    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52658e31-b412-42b9-8367-f2f7b43b762f-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.651750 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.651673    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52658e31-b412-42b9-8367-f2f7b43b762f-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:41.653872 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.653850    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-aff7af-openshift-default-57d545448-zcjvd"]
Sep 16 13:57:41.838981 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:41.838893    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" path="/var/lib/kubelet/pods/52658e31-b412-42b9-8367-f2f7b43b762f/volumes"
Sep 16 13:57:47.337359 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.337326    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"]
Sep 16 13:57:47.337846 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.337559    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7" podUID="b1b56e98-941d-435e-bb0a-3ef78896aaa8" containerName="payload-processing" containerID="cri-o://9b5ef0e9ffec295284bd4800f2f3f3a0b645dc0586df29f0f80039f86369bbed" gracePeriod=30
Sep 16 13:57:47.375847 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.372572    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"]
Sep 16 13:57:47.375847 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.373010    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf" podUID="69030757-7ba0-46a5-ae9a-383f0ef5e198" containerName="payload-pre-processing" containerID="cri-o://8e30d04b1a9d5486bd80f94f566b09b3ca1fdb30c8245cca5ab3985263785ea8" gracePeriod=30
Sep 16 13:57:47.653830 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.653794    2552 generic.go:356] "Generic (PLEG): container finished" podID="b1b56e98-941d-435e-bb0a-3ef78896aaa8" containerID="9b5ef0e9ffec295284bd4800f2f3f3a0b645dc0586df29f0f80039f86369bbed" exitCode=0
Sep 16 13:57:47.654015 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.653978    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7" event={"ID":"b1b56e98-941d-435e-bb0a-3ef78896aaa8","Type":"ContainerDied","Data":"9b5ef0e9ffec295284bd4800f2f3f3a0b645dc0586df29f0f80039f86369bbed"}
Sep 16 13:57:47.654071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.654032    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7" event={"ID":"b1b56e98-941d-435e-bb0a-3ef78896aaa8","Type":"ContainerDied","Data":"daaaa9f77278c364666dc853709c6a75cfbd7b35f4074ff7f0a333bd049058d0"}
Sep 16 13:57:47.654071 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.654055    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daaaa9f77278c364666dc853709c6a75cfbd7b35f4074ff7f0a333bd049058d0"
Sep 16 13:57:47.655843 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.655816    2552 generic.go:356] "Generic (PLEG): container finished" podID="69030757-7ba0-46a5-ae9a-383f0ef5e198" containerID="8e30d04b1a9d5486bd80f94f566b09b3ca1fdb30c8245cca5ab3985263785ea8" exitCode=0
Sep 16 13:57:47.655962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.655855    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf" event={"ID":"69030757-7ba0-46a5-ae9a-383f0ef5e198","Type":"ContainerDied","Data":"8e30d04b1a9d5486bd80f94f566b09b3ca1fdb30c8245cca5ab3985263785ea8"}
Sep 16 13:57:47.655962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.655896    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf" event={"ID":"69030757-7ba0-46a5-ae9a-383f0ef5e198","Type":"ContainerDied","Data":"cc586ee87b96e5bf8d3b715b47da32094e081f7da58297b3c0bddc3c5190f5f7"}
Sep 16 13:57:47.655962 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.655918    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc586ee87b96e5bf8d3b715b47da32094e081f7da58297b3c0bddc3c5190f5f7"
Sep 16 13:57:47.661892 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.661854    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:57:47.664926 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.664907    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:57:47.706643 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.706386    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn7s2\" (UniqueName: \"kubernetes.io/projected/69030757-7ba0-46a5-ae9a-383f0ef5e198-kube-api-access-gn7s2\") pod \"69030757-7ba0-46a5-ae9a-383f0ef5e198\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") "
Sep 16 13:57:47.706643 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.706466    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b56e98-941d-435e-bb0a-3ef78896aaa8-plugins-config-volume\") pod \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") "
Sep 16 13:57:47.706643 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.706502    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5g46\" (UniqueName: \"kubernetes.io/projected/b1b56e98-941d-435e-bb0a-3ef78896aaa8-kube-api-access-s5g46\") pod \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\" (UID: \"b1b56e98-941d-435e-bb0a-3ef78896aaa8\") "
Sep 16 13:57:47.707517 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.707054    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69030757-7ba0-46a5-ae9a-383f0ef5e198-plugins-config-volume\") pod \"69030757-7ba0-46a5-ae9a-383f0ef5e198\" (UID: \"69030757-7ba0-46a5-ae9a-383f0ef5e198\") "
Sep 16 13:57:47.707517 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.707170    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b56e98-941d-435e-bb0a-3ef78896aaa8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1b56e98-941d-435e-bb0a-3ef78896aaa8" (UID: "b1b56e98-941d-435e-bb0a-3ef78896aaa8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:47.707517 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.707485    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69030757-7ba0-46a5-ae9a-383f0ef5e198-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69030757-7ba0-46a5-ae9a-383f0ef5e198" (UID: "69030757-7ba0-46a5-ae9a-383f0ef5e198"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:57:47.707788 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.707537    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1b56e98-941d-435e-bb0a-3ef78896aaa8-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:47.710612 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.710578    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b56e98-941d-435e-bb0a-3ef78896aaa8-kube-api-access-s5g46" (OuterVolumeSpecName: "kube-api-access-s5g46") pod "b1b56e98-941d-435e-bb0a-3ef78896aaa8" (UID: "b1b56e98-941d-435e-bb0a-3ef78896aaa8"). InnerVolumeSpecName "kube-api-access-s5g46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:47.711310 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.711285    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69030757-7ba0-46a5-ae9a-383f0ef5e198-kube-api-access-gn7s2" (OuterVolumeSpecName: "kube-api-access-gn7s2") pod "69030757-7ba0-46a5-ae9a-383f0ef5e198" (UID: "69030757-7ba0-46a5-ae9a-383f0ef5e198"). InnerVolumeSpecName "kube-api-access-gn7s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:57:47.809501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.809469    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn7s2\" (UniqueName: \"kubernetes.io/projected/69030757-7ba0-46a5-ae9a-383f0ef5e198-kube-api-access-gn7s2\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:47.809501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.809496    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5g46\" (UniqueName: \"kubernetes.io/projected/b1b56e98-941d-435e-bb0a-3ef78896aaa8-kube-api-access-s5g46\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:47.809501 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:47.809505    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69030757-7ba0-46a5-ae9a-383f0ef5e198-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 13:57:48.661896 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:48.661865    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"
Sep 16 13:57:48.662258 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:48.661870    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"
Sep 16 13:57:48.690810 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:48.690785    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"]
Sep 16 13:57:48.694719 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:48.694694    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f2afd5-7df6595c78-l58rf"]
Sep 16 13:57:48.713452 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:48.713431    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"]
Sep 16 13:57:48.722175 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:48.722152    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f2afd5-6ffc9ffc7f-9nzz7"]
Sep 16 13:57:49.838240 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:49.838210    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69030757-7ba0-46a5-ae9a-383f0ef5e198" path="/var/lib/kubelet/pods/69030757-7ba0-46a5-ae9a-383f0ef5e198/volumes"
Sep 16 13:57:49.838685 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:49.838567    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b56e98-941d-435e-bb0a-3ef78896aaa8" path="/var/lib/kubelet/pods/b1b56e98-941d-435e-bb0a-3ef78896aaa8/volumes"
Sep 16 13:57:55.963333 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:55.963304    2552 scope.go:117] "RemoveContainer" containerID="8e30d04b1a9d5486bd80f94f566b09b3ca1fdb30c8245cca5ab3985263785ea8"
Sep 16 13:57:55.971913 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:55.971893    2552 scope.go:117] "RemoveContainer" containerID="9b5ef0e9ffec295284bd4800f2f3f3a0b645dc0586df29f0f80039f86369bbed"
Sep 16 13:57:55.980669 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:57:55.980645    2552 scope.go:117] "RemoveContainer" containerID="047de300fb513f0a5f89cdd7513d82121526ea1be68b7168c7f97adb31b94d72"
Sep 16 13:58:56.029715 ip-10-0-129-205 kubenswrapper[2552]: I0916 13:58:56.029687    2552 scope.go:117] "RemoveContainer" containerID="fa2a80f2eea7cf665746fb0b2f09cca385c588c112c676cabce80c263ac235db"
Sep 16 14:00:00.189649 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.189616    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"]
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190004    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8593acf-741d-4743-87fc-2e9370265503" containerName="revoke-keys"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190015    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8593acf-741d-4743-87fc-2e9370265503" containerName="revoke-keys"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190022    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190027    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190036    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190042    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190051    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69030757-7ba0-46a5-ae9a-383f0ef5e198" containerName="payload-pre-processing"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190057    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="69030757-7ba0-46a5-ae9a-383f0ef5e198" containerName="payload-pre-processing"
Sep 16 14:00:00.190068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190070    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b56e98-941d-435e-bb0a-3ef78896aaa8" containerName="payload-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190075    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b56e98-941d-435e-bb0a-3ef78896aaa8" containerName="payload-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190084    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e79e659-a29a-46fd-974c-9cefb2597724" containerName="payload-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190089    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e79e659-a29a-46fd-974c-9cefb2597724" containerName="payload-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190100    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" containerName="payload-pre-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190105    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" containerName="payload-pre-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190169    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="69030757-7ba0-46a5-ae9a-383f0ef5e198" containerName="payload-pre-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190178    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190184    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="52658e31-b412-42b9-8367-f2f7b43b762f" containerName="istio-proxy"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190190    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b56e98-941d-435e-bb0a-3ef78896aaa8" containerName="payload-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190197    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cded68a-0a5b-4f8d-abf8-dd9bd44b3418" containerName="payload-pre-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190203    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e79e659-a29a-46fd-974c-9cefb2597724" containerName="payload-processing"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190208    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8593acf-741d-4743-87fc-2e9370265503" containerName="revoke-keys"
Sep 16 14:00:00.190364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.190216    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="63816847-5ec3-4a5e-8475-09708f56c80d" containerName="istio-proxy"
Sep 16 14:00:00.193198 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.193182    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"
Sep 16 14:00:00.201287 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.201264    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 14:00:00.202728 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.202714    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"
Sep 16 14:00:00.221965 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.221921    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"]
Sep 16 14:00:00.492421 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:00.492398    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"]
Sep 16 14:00:00.494561 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:00:00.494525    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e680031_7d05_488e_bea6_5f4c1ae7ebb0.slice/crio-25500c0e53415aa249293d8351aabfa138d3f93b1bb5523ee979db7d2f846955 WatchSource:0}: Error finding container 25500c0e53415aa249293d8351aabfa138d3f93b1bb5523ee979db7d2f846955: Status 404 returned error can't find the container with id 25500c0e53415aa249293d8351aabfa138d3f93b1bb5523ee979db7d2f846955
Sep 16 14:00:01.342429 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:01.342384    2552 generic.go:356] "Generic (PLEG): container finished" podID="4e680031-7d05-488e-bea6-5f4c1ae7ebb0" containerID="9f841ed6eedd1fbbc8d70918c96704bc7c0950ee9f21a8b1181d68d610f40695" exitCode=0
Sep 16 14:00:01.342807 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:01.342447    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg" event={"ID":"4e680031-7d05-488e-bea6-5f4c1ae7ebb0","Type":"ContainerDied","Data":"9f841ed6eedd1fbbc8d70918c96704bc7c0950ee9f21a8b1181d68d610f40695"}
Sep 16 14:00:01.342807 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:01.342497    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg" event={"ID":"4e680031-7d05-488e-bea6-5f4c1ae7ebb0","Type":"ContainerStarted","Data":"25500c0e53415aa249293d8351aabfa138d3f93b1bb5523ee979db7d2f846955"}
Sep 16 14:00:02.485251 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:02.485228    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"
Sep 16 14:00:03.359034 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:03.359003    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"
Sep 16 14:00:03.359034 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:03.359008    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg" event={"ID":"4e680031-7d05-488e-bea6-5f4c1ae7ebb0","Type":"ContainerDied","Data":"25500c0e53415aa249293d8351aabfa138d3f93b1bb5523ee979db7d2f846955"}
Sep 16 14:00:03.359355 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:03.359066    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25500c0e53415aa249293d8351aabfa138d3f93b1bb5523ee979db7d2f846955"
Sep 16 14:00:55.153077 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.153027    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"]
Sep 16 14:00:55.153675 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.153649    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e680031-7d05-488e-bea6-5f4c1ae7ebb0" containerName="cleanup"
Sep 16 14:00:55.153675 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.153676    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e680031-7d05-488e-bea6-5f4c1ae7ebb0" containerName="cleanup"
Sep 16 14:00:55.153850 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.153812    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e680031-7d05-488e-bea6-5f4c1ae7ebb0" containerName="cleanup"
Sep 16 14:00:55.162775 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.162756    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.166460 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.166442    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b59887-openshift-default-dockercfg-zhknr\""
Sep 16 14:00:55.174310 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.174284    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"]
Sep 16 14:00:55.183732 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183708    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-token\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.183847 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183757    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-certs\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.183847 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183777    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-credential-socket\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.183973 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183842    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-podinfo\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.183973 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183876    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-envoy\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.183973 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-socket\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.183973 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183964    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-data\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.184195 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.183987    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istiod-ca-cert\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.184195 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.184048    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mvp9\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-kube-api-access-4mvp9\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285569 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285507    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-certs\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285569 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285563    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-credential-socket\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285588    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-podinfo\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-envoy\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285646    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-socket\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285707    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-data\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285744    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istiod-ca-cert\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.285820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285779    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mvp9\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-kube-api-access-4mvp9\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.286156 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285839    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-token\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.286156 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.285993    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-credential-socket\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.286328 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.286218    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-socket\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.286467 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.286348    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-data\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.287035 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.286687    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-certs\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.287185 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.286807    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istiod-ca-cert\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.288685 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.288665    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-envoy\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.289422 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.289403    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-podinfo\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.298320 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.298288    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-token\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.298441 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.298332    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mvp9\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-kube-api-access-4mvp9\") pod \"e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") " pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.475113 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.475035    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:55.770185 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.770151    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 14:00:55.773080 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.773054    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 14:00:55.822821 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.822800    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"]
Sep 16 14:00:55.824236 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:00:55.824210    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c443279_4d6e_4e16_8bde_c7be8f9e1703.slice/crio-ca1805a979c127623e0bf2f195a65927abade50cee9ea51dac34a9101ebb5a2e WatchSource:0}: Error finding container ca1805a979c127623e0bf2f195a65927abade50cee9ea51dac34a9101ebb5a2e: Status 404 returned error can't find the container with id ca1805a979c127623e0bf2f195a65927abade50cee9ea51dac34a9101ebb5a2e
Sep 16 14:00:55.826342 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.826313    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:00:55.826420 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.826371    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:00:55.826420 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:55.826400    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:00:56.633878 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:56.633842    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" event={"ID":"5c443279-4d6e-4e16-8bde-c7be8f9e1703","Type":"ContainerStarted","Data":"a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"}
Sep 16 14:00:56.634343 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:56.633918    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" event={"ID":"5c443279-4d6e-4e16-8bde-c7be8f9e1703","Type":"ContainerStarted","Data":"ca1805a979c127623e0bf2f195a65927abade50cee9ea51dac34a9101ebb5a2e"}
Sep 16 14:00:56.660226 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:56.660180    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podStartSLOduration=1.660166821 podStartE2EDuration="1.660166821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:00:56.65839193 +0000 UTC m=+1801.412082054" watchObservedRunningTime="2026-09-16 14:00:56.660166821 +0000 UTC m=+1801.413856942"
Sep 16 14:00:57.476022 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:57.475988    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:57.480965 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:57.480943    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:57.640112 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:57.640081    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:00:57.640860 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:00:57.640841    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:01:13.681694 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:13.681652    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:01:13.682106 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:13.681769    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:01:15.735128 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:15.735094    2552 generic.go:356] "Generic (PLEG): container finished" podID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerID="a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b" exitCode=0
Sep 16 14:01:15.735530 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:15.735153    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" event={"ID":"5c443279-4d6e-4e16-8bde-c7be8f9e1703","Type":"ContainerDied","Data":"a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"}
Sep 16 14:01:15.735598 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:15.735556    2552 scope.go:117] "RemoveContainer" containerID="a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"
Sep 16 14:01:15.736528 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:15.736497    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:01:15.736599 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:15.736585    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:01:15.736637 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:15.736621    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 16 14:01:16.742247 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:16.742206    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" event={"ID":"5c443279-4d6e-4e16-8bde-c7be8f9e1703","Type":"ContainerStarted","Data":"ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4"}
Sep 16 14:01:17.475751 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:17.475717    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:01:17.475965 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:17.475943    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 16 14:01:17.476012 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:17.475992    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 16 14:01:18.475885 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:18.475851    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 16 14:01:18.476260 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:18.475905    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 16 14:01:19.476032 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:19.475995    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 16 14:01:19.476415 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:19.476072    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 16 14:01:20.476280 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:20.476246    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 16 14:01:20.476694 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:20.476305    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 16 14:01:21.476243 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:21.476209    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 16 14:01:21.476422 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:21.476262    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 16 14:01:22.479272 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:22.479241    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:01:22.479657 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:22.479528    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:01:22.480327 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:22.480311    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:01:30.781714 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.781677    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"]
Sep 16 14:01:30.785372 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.785346    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:30.788213 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.788186    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-ac4a3c\""
Sep 16 14:01:30.797524 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.797501    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"]
Sep 16 14:01:30.806659 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.806635    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"]
Sep 16 14:01:30.810360 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.810344    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.814036 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.814012    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-ac4a3c-dockercfg-gmxt2\""
Sep 16 14:01:30.827516 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.827494    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"]
Sep 16 14:01:30.836766 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.836741    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/1e5cbec8-f2d5-460a-9295-8abce2fa6129-kube-api-access-xvxxr\") pod \"payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.836878 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.836832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:30.836977 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.836947    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5cbec8-f2d5-460a-9295-8abce2fa6129-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.837048 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.836992    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-kube-api-access-bvndp\") pod \"payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:30.937912 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.937874    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5cbec8-f2d5-460a-9295-8abce2fa6129-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.937912 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.937913    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-kube-api-access-bvndp\") pod \"payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:30.938118 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.937965    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/1e5cbec8-f2d5-460a-9295-8abce2fa6129-kube-api-access-xvxxr\") pod \"payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.938118 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.938005    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:30.938657 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.938637    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5cbec8-f2d5-460a-9295-8abce2fa6129-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.938704 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.938652    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:30.947662 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.947636    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/1e5cbec8-f2d5-460a-9295-8abce2fa6129-kube-api-access-xvxxr\") pod \"payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:30.947864 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:30.947846    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-kube-api-access-bvndp\") pod \"payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:31.096659 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.096579    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:31.121916 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.121890    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:31.374017 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.373991    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"]
Sep 16 14:01:31.374997 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:01:31.374975    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec09ec9_38d6_46b7_93ad_fdbe03d22af1.slice/crio-728d286a894f6d290c68d575c00ebc36d153ae94043ae3b2c0cd3fcd331aa60c WatchSource:0}: Error finding container 728d286a894f6d290c68d575c00ebc36d153ae94043ae3b2c0cd3fcd331aa60c: Status 404 returned error can't find the container with id 728d286a894f6d290c68d575c00ebc36d153ae94043ae3b2c0cd3fcd331aa60c
Sep 16 14:01:31.407713 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.407693    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"]
Sep 16 14:01:31.409492 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:01:31.409466    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5cbec8_f2d5_460a_9295_8abce2fa6129.slice/crio-338c169f85861634ff7d1081874c5721f8ee2d83197cb166bce8d8090f1ca353 WatchSource:0}: Error finding container 338c169f85861634ff7d1081874c5721f8ee2d83197cb166bce8d8090f1ca353: Status 404 returned error can't find the container with id 338c169f85861634ff7d1081874c5721f8ee2d83197cb166bce8d8090f1ca353
Sep 16 14:01:31.838202 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.838175    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:31.838612 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.838222    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:31.838612 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.838243    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr" event={"ID":"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1","Type":"ContainerStarted","Data":"78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a"}
Sep 16 14:01:31.838612 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.838260    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr" event={"ID":"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1","Type":"ContainerStarted","Data":"728d286a894f6d290c68d575c00ebc36d153ae94043ae3b2c0cd3fcd331aa60c"}
Sep 16 14:01:31.838612 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.838277    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz" event={"ID":"1e5cbec8-f2d5-460a-9295-8abce2fa6129","Type":"ContainerStarted","Data":"03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99"}
Sep 16 14:01:31.838612 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.838297    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz" event={"ID":"1e5cbec8-f2d5-460a-9295-8abce2fa6129","Type":"ContainerStarted","Data":"338c169f85861634ff7d1081874c5721f8ee2d83197cb166bce8d8090f1ca353"}
Sep 16 14:01:31.851319 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.851269    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr" podStartSLOduration=1.851250517 podStartE2EDuration="1.851250517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:01:31.850082993 +0000 UTC m=+1836.603773115" watchObservedRunningTime="2026-09-16 14:01:31.851250517 +0000 UTC m=+1836.604940641"
Sep 16 14:01:31.870618 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:31.870575    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz" podStartSLOduration=1.870532139 podStartE2EDuration="1.870532139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:01:31.868499442 +0000 UTC m=+1836.622189562" watchObservedRunningTime="2026-09-16 14:01:31.870532139 +0000 UTC m=+1836.624222259"
Sep 16 14:01:42.842028 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:42.841995    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:01:43.848965 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:43.848930    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:01:57.592178 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:57.592147    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9zkpq_7453cbbd-6a0d-4c00-9d10-72457dbdc457/payload-processing/0.log"
Sep 16 14:01:57.723186 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:01:57.723161    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz_1e5cbec8-f2d5-460a-9295-8abce2fa6129/payload-processing/0.log"
Sep 16 14:02:49.052071 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:49.052037    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9zkpq_7453cbbd-6a0d-4c00-9d10-72457dbdc457/payload-processing/0.log"
Sep 16 14:02:49.170994 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:49.170972    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz_1e5cbec8-f2d5-460a-9295-8abce2fa6129/payload-processing/0.log"
Sep 16 14:02:57.237244 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.237205    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"]
Sep 16 14:02:57.241160 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.241143    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.244263 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.244242    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-bf580f\""
Sep 16 14:02:57.244558 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.244530    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-bf580f-dockercfg-vbc79\""
Sep 16 14:02:57.255943 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.255922    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"]
Sep 16 14:02:57.265626 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.265606    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"]
Sep 16 14:02:57.269137 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.269111    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.280434 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.280410    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"]
Sep 16 14:02:57.312853 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.312829    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29484279-567b-4f19-aa4c-db9ebc8671f5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.312957 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.312897    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc4e306-39ed-4c5d-81fb-a8f59478061c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.312957 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.312943    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks8pr\" (UniqueName: \"kubernetes.io/projected/29484279-567b-4f19-aa4c-db9ebc8671f5-kube-api-access-ks8pr\") pod \"payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.313036 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.312962    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgwpg\" (UniqueName: \"kubernetes.io/projected/dfc4e306-39ed-4c5d-81fb-a8f59478061c-kube-api-access-dgwpg\") pod \"payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.413939 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.413905    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29484279-567b-4f19-aa4c-db9ebc8671f5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.414116 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.413964    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc4e306-39ed-4c5d-81fb-a8f59478061c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.414116 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.414004    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks8pr\" (UniqueName: \"kubernetes.io/projected/29484279-567b-4f19-aa4c-db9ebc8671f5-kube-api-access-ks8pr\") pod \"payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.414116 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.414031    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgwpg\" (UniqueName: \"kubernetes.io/projected/dfc4e306-39ed-4c5d-81fb-a8f59478061c-kube-api-access-dgwpg\") pod \"payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.414681 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.414656    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29484279-567b-4f19-aa4c-db9ebc8671f5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.414794 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.414737    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc4e306-39ed-4c5d-81fb-a8f59478061c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.423901 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.423870    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks8pr\" (UniqueName: \"kubernetes.io/projected/29484279-567b-4f19-aa4c-db9ebc8671f5-kube-api-access-ks8pr\") pod \"payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.424246 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.424230    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgwpg\" (UniqueName: \"kubernetes.io/projected/dfc4e306-39ed-4c5d-81fb-a8f59478061c-kube-api-access-dgwpg\") pod \"payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.552288 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.552256    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:57.579727 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.579690    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:57.834779 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:02:57.834743    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc4e306_39ed_4c5d_81fb_a8f59478061c.slice/crio-418a2e48fa361dc1b64dc9be8292e5ed0371fd4ac944692c82d0da33db2f127c WatchSource:0}: Error finding container 418a2e48fa361dc1b64dc9be8292e5ed0371fd4ac944692c82d0da33db2f127c: Status 404 returned error can't find the container with id 418a2e48fa361dc1b64dc9be8292e5ed0371fd4ac944692c82d0da33db2f127c
Sep 16 14:02:57.840874 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.840852    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"]
Sep 16 14:02:57.873847 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:57.873827    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"]
Sep 16 14:02:57.883277 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:02:57.878084    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29484279_567b_4f19_aa4c_db9ebc8671f5.slice/crio-a0d303c4ee607ac14cb43cf4b3c0e52b89d9f8aa88520ce6835a7e7280e4b0f5 WatchSource:0}: Error finding container a0d303c4ee607ac14cb43cf4b3c0e52b89d9f8aa88520ce6835a7e7280e4b0f5: Status 404 returned error can't find the container with id a0d303c4ee607ac14cb43cf4b3c0e52b89d9f8aa88520ce6835a7e7280e4b0f5
Sep 16 14:02:58.294245 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.294209    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd" event={"ID":"29484279-567b-4f19-aa4c-db9ebc8671f5","Type":"ContainerStarted","Data":"1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986"}
Sep 16 14:02:58.294726 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.294312    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd" event={"ID":"29484279-567b-4f19-aa4c-db9ebc8671f5","Type":"ContainerStarted","Data":"a0d303c4ee607ac14cb43cf4b3c0e52b89d9f8aa88520ce6835a7e7280e4b0f5"}
Sep 16 14:02:58.294726 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.294347    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:02:58.295932 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.295904    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz" event={"ID":"dfc4e306-39ed-4c5d-81fb-a8f59478061c","Type":"ContainerStarted","Data":"0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4"}
Sep 16 14:02:58.296071 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.295946    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz" event={"ID":"dfc4e306-39ed-4c5d-81fb-a8f59478061c","Type":"ContainerStarted","Data":"418a2e48fa361dc1b64dc9be8292e5ed0371fd4ac944692c82d0da33db2f127c"}
Sep 16 14:02:58.296071 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.296012    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:02:58.313219 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.313128    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd" podStartSLOduration=1.313112036 podStartE2EDuration="1.313112036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:02:58.312778576 +0000 UTC m=+1923.066468698" watchObservedRunningTime="2026-09-16 14:02:58.313112036 +0000 UTC m=+1923.066802158"
Sep 16 14:02:58.335140 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:02:58.335092    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz" podStartSLOduration=1.335077468 podStartE2EDuration="1.335077468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:02:58.332768752 +0000 UTC m=+1923.086458874" watchObservedRunningTime="2026-09-16 14:02:58.335077468 +0000 UTC m=+1923.088767628"
Sep 16 14:03:09.302950 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:09.302920    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:03:09.303471 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:09.303003    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:03:34.860854 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:34.860810    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"]
Sep 16 14:03:34.861311 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:34.861054    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd" podUID="29484279-567b-4f19-aa4c-db9ebc8671f5" containerName="payload-processing" containerID="cri-o://1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986" gracePeriod=30
Sep 16 14:03:34.871234 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:34.871211    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"]
Sep 16 14:03:34.871601 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:34.871397    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz" podUID="dfc4e306-39ed-4c5d-81fb-a8f59478061c" containerName="payload-pre-processing" containerID="cri-o://0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4" gracePeriod=30
Sep 16 14:03:35.140828 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.140795    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:03:35.177182 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.177156    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:03:35.253141 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253111    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgwpg\" (UniqueName: \"kubernetes.io/projected/dfc4e306-39ed-4c5d-81fb-a8f59478061c-kube-api-access-dgwpg\") pod \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") "
Sep 16 14:03:35.253331 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253153    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29484279-567b-4f19-aa4c-db9ebc8671f5-plugins-config-volume\") pod \"29484279-567b-4f19-aa4c-db9ebc8671f5\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") "
Sep 16 14:03:35.253331 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253208    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc4e306-39ed-4c5d-81fb-a8f59478061c-plugins-config-volume\") pod \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\" (UID: \"dfc4e306-39ed-4c5d-81fb-a8f59478061c\") "
Sep 16 14:03:35.253331 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253297    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks8pr\" (UniqueName: \"kubernetes.io/projected/29484279-567b-4f19-aa4c-db9ebc8671f5-kube-api-access-ks8pr\") pod \"29484279-567b-4f19-aa4c-db9ebc8671f5\" (UID: \"29484279-567b-4f19-aa4c-db9ebc8671f5\") "
Sep 16 14:03:35.253566 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253532    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29484279-567b-4f19-aa4c-db9ebc8671f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29484279-567b-4f19-aa4c-db9ebc8671f5" (UID: "29484279-567b-4f19-aa4c-db9ebc8671f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:03:35.253644 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253631    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29484279-567b-4f19-aa4c-db9ebc8671f5-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:03:35.253700 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.253648    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc4e306-39ed-4c5d-81fb-a8f59478061c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfc4e306-39ed-4c5d-81fb-a8f59478061c" (UID: "dfc4e306-39ed-4c5d-81fb-a8f59478061c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:03:35.255384 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.255360    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc4e306-39ed-4c5d-81fb-a8f59478061c-kube-api-access-dgwpg" (OuterVolumeSpecName: "kube-api-access-dgwpg") pod "dfc4e306-39ed-4c5d-81fb-a8f59478061c" (UID: "dfc4e306-39ed-4c5d-81fb-a8f59478061c"). InnerVolumeSpecName "kube-api-access-dgwpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:03:35.255519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.255394    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29484279-567b-4f19-aa4c-db9ebc8671f5-kube-api-access-ks8pr" (OuterVolumeSpecName: "kube-api-access-ks8pr") pod "29484279-567b-4f19-aa4c-db9ebc8671f5" (UID: "29484279-567b-4f19-aa4c-db9ebc8671f5"). InnerVolumeSpecName "kube-api-access-ks8pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:03:35.354812 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.354776    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfc4e306-39ed-4c5d-81fb-a8f59478061c-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:03:35.354812 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.354803    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks8pr\" (UniqueName: \"kubernetes.io/projected/29484279-567b-4f19-aa4c-db9ebc8671f5-kube-api-access-ks8pr\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:03:35.354812 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.354812    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgwpg\" (UniqueName: \"kubernetes.io/projected/dfc4e306-39ed-4c5d-81fb-a8f59478061c-kube-api-access-dgwpg\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:03:35.494044 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.493952    2552 generic.go:356] "Generic (PLEG): container finished" podID="29484279-567b-4f19-aa4c-db9ebc8671f5" containerID="1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986" exitCode=0
Sep 16 14:03:35.494044 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.493996    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"
Sep 16 14:03:35.494249 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.494039    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd" event={"ID":"29484279-567b-4f19-aa4c-db9ebc8671f5","Type":"ContainerDied","Data":"1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986"}
Sep 16 14:03:35.494249 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.494127    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd" event={"ID":"29484279-567b-4f19-aa4c-db9ebc8671f5","Type":"ContainerDied","Data":"a0d303c4ee607ac14cb43cf4b3c0e52b89d9f8aa88520ce6835a7e7280e4b0f5"}
Sep 16 14:03:35.494249 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.494168    2552 scope.go:117] "RemoveContainer" containerID="1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986"
Sep 16 14:03:35.495466 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.495436    2552 generic.go:356] "Generic (PLEG): container finished" podID="dfc4e306-39ed-4c5d-81fb-a8f59478061c" containerID="0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4" exitCode=0
Sep 16 14:03:35.495590 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.495481    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"
Sep 16 14:03:35.495590 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.495482    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz" event={"ID":"dfc4e306-39ed-4c5d-81fb-a8f59478061c","Type":"ContainerDied","Data":"0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4"}
Sep 16 14:03:35.495590 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.495534    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz" event={"ID":"dfc4e306-39ed-4c5d-81fb-a8f59478061c","Type":"ContainerDied","Data":"418a2e48fa361dc1b64dc9be8292e5ed0371fd4ac944692c82d0da33db2f127c"}
Sep 16 14:03:35.504575 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.504557    2552 scope.go:117] "RemoveContainer" containerID="1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986"
Sep 16 14:03:35.504870 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:03:35.504849    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986\": container with ID starting with 1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986 not found: ID does not exist" containerID="1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986"
Sep 16 14:03:35.504983 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.504879    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986"} err="failed to get container status \"1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986\": rpc error: code = NotFound desc = could not find container \"1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986\": container with ID starting with 1131447087fb7682cde2964e23196fb4646f45884815808a0c04e519179b6986 not found: ID does not exist"
Sep 16 14:03:35.504983 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.504901    2552 scope.go:117] "RemoveContainer" containerID="0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4"
Sep 16 14:03:35.513430 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.513416    2552 scope.go:117] "RemoveContainer" containerID="0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4"
Sep 16 14:03:35.513765 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:03:35.513748    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4\": container with ID starting with 0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4 not found: ID does not exist" containerID="0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4"
Sep 16 14:03:35.513816 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.513772    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4"} err="failed to get container status \"0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4\": rpc error: code = NotFound desc = could not find container \"0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4\": container with ID starting with 0260bb6a01ecf1a1bf8c36361f660eff6a6b02bcee463d640b9a5943ccf220d4 not found: ID does not exist"
Sep 16 14:03:35.521965 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.521946    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"]
Sep 16 14:03:35.526996 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.526977    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-bf580f-58b77dccbf-fmxwd"]
Sep 16 14:03:35.538266 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.538245    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"]
Sep 16 14:03:35.547374 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.547353    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-bf580f-867749ccd-wbhrz"]
Sep 16 14:03:35.838053 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.838012    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29484279-567b-4f19-aa4c-db9ebc8671f5" path="/var/lib/kubelet/pods/29484279-567b-4f19-aa4c-db9ebc8671f5/volumes"
Sep 16 14:03:35.838415 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:35.838401    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc4e306-39ed-4c5d-81fb-a8f59478061c" path="/var/lib/kubelet/pods/dfc4e306-39ed-4c5d-81fb-a8f59478061c/volumes"
Sep 16 14:03:45.769608 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.769575    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"]
Sep 16 14:03:45.770095 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.769997    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc4e306-39ed-4c5d-81fb-a8f59478061c" containerName="payload-pre-processing"
Sep 16 14:03:45.770095 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.770009    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc4e306-39ed-4c5d-81fb-a8f59478061c" containerName="payload-pre-processing"
Sep 16 14:03:45.770095 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.770033    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29484279-567b-4f19-aa4c-db9ebc8671f5" containerName="payload-processing"
Sep 16 14:03:45.770095 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.770038    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="29484279-567b-4f19-aa4c-db9ebc8671f5" containerName="payload-processing"
Sep 16 14:03:45.770245 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.770103    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="29484279-567b-4f19-aa4c-db9ebc8671f5" containerName="payload-processing"
Sep 16 14:03:45.770245 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.770113    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc4e306-39ed-4c5d-81fb-a8f59478061c" containerName="payload-pre-processing"
Sep 16 14:03:45.774679 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.774661    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:45.777498 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.777476    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 14:03:45.784173 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.784144    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"]
Sep 16 14:03:45.852457 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.852420    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx\" (UID: \"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:45.953517 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.953483    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx\" (UID: \"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:45.954064 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:45.954045    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx\" (UID: \"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:46.088464 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:46.088385    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:46.366075 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:46.366051    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"]
Sep 16 14:03:46.367461 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:03:46.367427    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d8601b_b4af_4dcc_8d7e_003cd2ddb019.slice/crio-2f5a9ee14598b328ae679f32b4603867a3b1306850a3c40df2f1aa3f6835c4a6 WatchSource:0}: Error finding container 2f5a9ee14598b328ae679f32b4603867a3b1306850a3c40df2f1aa3f6835c4a6: Status 404 returned error can't find the container with id 2f5a9ee14598b328ae679f32b4603867a3b1306850a3c40df2f1aa3f6835c4a6
Sep 16 14:03:46.558014 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:46.557788    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx" event={"ID":"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019","Type":"ContainerStarted","Data":"2f5a9ee14598b328ae679f32b4603867a3b1306850a3c40df2f1aa3f6835c4a6"}
Sep 16 14:03:47.565059 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:47.565024    2552 generic.go:356] "Generic (PLEG): container finished" podID="f7d8601b-b4af-4dcc-8d7e-003cd2ddb019" containerID="23c6b781b5c0084add4d4dfbcf2e758a858a9c72b42b3afb54f7c9395120b607" exitCode=0
Sep 16 14:03:47.565488 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:47.565119    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx" event={"ID":"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019","Type":"ContainerDied","Data":"23c6b781b5c0084add4d4dfbcf2e758a858a9c72b42b3afb54f7c9395120b607"}
Sep 16 14:03:48.708072 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:48.708047    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:48.778935 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:48.778908    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019-maas-api-service-ca\") pod \"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019\" (UID: \"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019\") "
Sep 16 14:03:48.779208 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:48.779188    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7d8601b-b4af-4dcc-8d7e-003cd2ddb019" (UID: "f7d8601b-b4af-4dcc-8d7e-003cd2ddb019"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:03:48.879809 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:48.879745    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:03:49.576557 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:49.576525    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx" event={"ID":"f7d8601b-b4af-4dcc-8d7e-003cd2ddb019","Type":"ContainerDied","Data":"2f5a9ee14598b328ae679f32b4603867a3b1306850a3c40df2f1aa3f6835c4a6"}
Sep 16 14:03:49.576721 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:49.576584    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"
Sep 16 14:03:49.576721 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:49.576592    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f5a9ee14598b328ae679f32b4603867a3b1306850a3c40df2f1aa3f6835c4a6"
Sep 16 14:03:56.082873 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:03:56.082844    2552 scope.go:117] "RemoveContainer" containerID="f687ddf351f495df34336fbfb2a3b58b7d12d15c7b0761ad24a3308432ffac25"
Sep 16 14:04:01.741414 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:04:01.741373    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"]
Sep 16 14:04:01.744683 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:04:01.744658    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b59887-q6hzx"]
Sep 16 14:04:01.837824 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:04:01.837789    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7d8601b-b4af-4dcc-8d7e-003cd2ddb019" path="/var/lib/kubelet/pods/f7d8601b-b4af-4dcc-8d7e-003cd2ddb019/volumes"
Sep 16 14:04:57.465156 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:04:57.465123    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"]
Sep 16 14:04:57.465616 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:04:57.465350    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy" containerID="cri-o://ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4" gracePeriod=30
Sep 16 14:05:02.718120 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.718097    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:05:02.842349 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842321    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-certs\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842535 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842356    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-socket\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842535 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842411    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-podinfo\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842535 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842438    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mvp9\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-kube-api-access-4mvp9\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842535 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842495    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-envoy\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842535 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842521    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-token\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842819 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842569    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-credential-socket\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842819 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842643    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:02.842819 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842658    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-data\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.842819 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842725    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:02.842819 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842736    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istiod-ca-cert\") pod \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\" (UID: \"5c443279-4d6e-4e16-8bde-c7be8f9e1703\") "
Sep 16 14:05:02.843100 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.842959    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:02.843100 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843076    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:02.843217 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843168    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:02.843276 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843262    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.843335 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843280    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.843335 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843294    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.843335 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843306    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.843335 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.843321    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.844724 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.844686    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-kube-api-access-4mvp9" (OuterVolumeSpecName: "kube-api-access-4mvp9") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "kube-api-access-4mvp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:02.844838 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.844778    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:02.844838 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.844789    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:05:02.844838 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.844789    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c443279-4d6e-4e16-8bde-c7be8f9e1703" (UID: "5c443279-4d6e-4e16-8bde-c7be8f9e1703"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:02.944556 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.944528    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.944659 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.944573    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mvp9\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-kube-api-access-4mvp9\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.944659 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.944584    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.944659 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.944592    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c443279-4d6e-4e16-8bde-c7be8f9e1703-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:02.970415 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.970383    2552 generic.go:356] "Generic (PLEG): container finished" podID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerID="ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4" exitCode=0
Sep 16 14:05:02.970572 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.970455    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"
Sep 16 14:05:02.970572 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.970465    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" event={"ID":"5c443279-4d6e-4e16-8bde-c7be8f9e1703","Type":"ContainerDied","Data":"ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4"}
Sep 16 14:05:02.970572 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.970519    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5" event={"ID":"5c443279-4d6e-4e16-8bde-c7be8f9e1703","Type":"ContainerDied","Data":"ca1805a979c127623e0bf2f195a65927abade50cee9ea51dac34a9101ebb5a2e"}
Sep 16 14:05:02.970572 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.970554    2552 scope.go:117] "RemoveContainer" containerID="ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4"
Sep 16 14:05:02.980122 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.980107    2552 scope.go:117] "RemoveContainer" containerID="a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"
Sep 16 14:05:02.988025 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.988007    2552 scope.go:117] "RemoveContainer" containerID="ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4"
Sep 16 14:05:02.988302 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:02.988284    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4\": container with ID starting with ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4 not found: ID does not exist" containerID="ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4"
Sep 16 14:05:02.988356 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.988309    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4"} err="failed to get container status \"ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4\": rpc error: code = NotFound desc = could not find container \"ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4\": container with ID starting with ee6d904a4b2ee99cca2c74776538cb67b3acfa7c0f812ddaaf37b3f0094f54d4 not found: ID does not exist"
Sep 16 14:05:02.988356 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.988326    2552 scope.go:117] "RemoveContainer" containerID="a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"
Sep 16 14:05:02.988594 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:02.988574    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b\": container with ID starting with a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b not found: ID does not exist" containerID="a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"
Sep 16 14:05:02.988640 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:02.988601    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b"} err="failed to get container status \"a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b\": rpc error: code = NotFound desc = could not find container \"a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b\": container with ID starting with a5fe29d87867e1e92801a1fe90979eafc4de64b4e4e505013120e107ce4e489b not found: ID does not exist"
Sep 16 14:05:03.001299 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:03.001279    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"]
Sep 16 14:05:03.004476 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:03.004459    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b59887-openshift-default-8b9cccd96-mrhg5"]
Sep 16 14:05:03.837834 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:03.837805    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" path="/var/lib/kubelet/pods/5c443279-4d6e-4e16-8bde-c7be8f9e1703/volumes"
Sep 16 14:05:08.609682 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.609648    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"]
Sep 16 14:05:08.610073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.609895    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz" podUID="1e5cbec8-f2d5-460a-9295-8abce2fa6129" containerName="payload-processing" containerID="cri-o://03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99" gracePeriod=30
Sep 16 14:05:08.614968 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.614940    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"]
Sep 16 14:05:08.615217 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.615169    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr" podUID="9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" containerName="payload-pre-processing" containerID="cri-o://78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a" gracePeriod=30
Sep 16 14:05:08.909142 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.909121    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:05:08.911897 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.911877    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:05:08.996806 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.996773    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5cbec8-f2d5-460a-9295-8abce2fa6129-plugins-config-volume\") pod \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") "
Sep 16 14:05:08.996956 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.996814    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-kube-api-access-bvndp\") pod \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") "
Sep 16 14:05:08.997020 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.996993    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-plugins-config-volume\") pod \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\" (UID: \"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1\") "
Sep 16 14:05:08.997073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.997037    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/1e5cbec8-f2d5-460a-9295-8abce2fa6129-kube-api-access-xvxxr\") pod \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\" (UID: \"1e5cbec8-f2d5-460a-9295-8abce2fa6129\") "
Sep 16 14:05:08.997141 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.997094    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e5cbec8-f2d5-460a-9295-8abce2fa6129-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e5cbec8-f2d5-460a-9295-8abce2fa6129" (UID: "1e5cbec8-f2d5-460a-9295-8abce2fa6129"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:08.997313 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.997295    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e5cbec8-f2d5-460a-9295-8abce2fa6129-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:08.997407 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.997365    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" (UID: "9ec09ec9-38d6-46b7-93ad-fdbe03d22af1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:08.998851 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.998830    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-kube-api-access-bvndp" (OuterVolumeSpecName: "kube-api-access-bvndp") pod "9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" (UID: "9ec09ec9-38d6-46b7-93ad-fdbe03d22af1"). InnerVolumeSpecName "kube-api-access-bvndp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:08.999045 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:08.999030    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e5cbec8-f2d5-460a-9295-8abce2fa6129-kube-api-access-xvxxr" (OuterVolumeSpecName: "kube-api-access-xvxxr") pod "1e5cbec8-f2d5-460a-9295-8abce2fa6129" (UID: "1e5cbec8-f2d5-460a-9295-8abce2fa6129"). InnerVolumeSpecName "kube-api-access-xvxxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:09.009216 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.009187    2552 generic.go:356] "Generic (PLEG): container finished" podID="9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" containerID="78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a" exitCode=0
Sep 16 14:05:09.009341 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.009235    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"
Sep 16 14:05:09.009341 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.009273    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr" event={"ID":"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1","Type":"ContainerDied","Data":"78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a"}
Sep 16 14:05:09.009468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.009345    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr" event={"ID":"9ec09ec9-38d6-46b7-93ad-fdbe03d22af1","Type":"ContainerDied","Data":"728d286a894f6d290c68d575c00ebc36d153ae94043ae3b2c0cd3fcd331aa60c"}
Sep 16 14:05:09.009468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.009378    2552 scope.go:117] "RemoveContainer" containerID="78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a"
Sep 16 14:05:09.010821 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.010803    2552 generic.go:356] "Generic (PLEG): container finished" podID="1e5cbec8-f2d5-460a-9295-8abce2fa6129" containerID="03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99" exitCode=0
Sep 16 14:05:09.010910 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.010837    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz" event={"ID":"1e5cbec8-f2d5-460a-9295-8abce2fa6129","Type":"ContainerDied","Data":"03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99"}
Sep 16 14:05:09.010910 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.010842    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"
Sep 16 14:05:09.010910 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.010865    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz" event={"ID":"1e5cbec8-f2d5-460a-9295-8abce2fa6129","Type":"ContainerDied","Data":"338c169f85861634ff7d1081874c5721f8ee2d83197cb166bce8d8090f1ca353"}
Sep 16 14:05:09.019259 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.019243    2552 scope.go:117] "RemoveContainer" containerID="78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a"
Sep 16 14:05:09.019646 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:09.019616    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a\": container with ID starting with 78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a not found: ID does not exist" containerID="78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a"
Sep 16 14:05:09.019721 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.019654    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a"} err="failed to get container status \"78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a\": rpc error: code = NotFound desc = could not find container \"78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a\": container with ID starting with 78d968520d35c8d441952a4f5725cb704c20af7f13aaf792c457722faf28a61a not found: ID does not exist"
Sep 16 14:05:09.019721 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.019671    2552 scope.go:117] "RemoveContainer" containerID="03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99"
Sep 16 14:05:09.027289 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.027273    2552 scope.go:117] "RemoveContainer" containerID="03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99"
Sep 16 14:05:09.027572 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:09.027535    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99\": container with ID starting with 03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99 not found: ID does not exist" containerID="03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99"
Sep 16 14:05:09.027645 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.027581    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99"} err="failed to get container status \"03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99\": rpc error: code = NotFound desc = could not find container \"03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99\": container with ID starting with 03812fc765a0a35aa7bfba307132912d6db0533d775712f931bdc00df44ebd99 not found: ID does not exist"
Sep 16 14:05:09.051168 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.051118    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"]
Sep 16 14:05:09.065128 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.065107    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ac4a3c-fd4869f4b-g9jgr"]
Sep 16 14:05:09.089286 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.089265    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"]
Sep 16 14:05:09.094415 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.094397    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ac4a3c-7d699f4657-kjwgz"]
Sep 16 14:05:09.097801 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.097783    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:09.097859 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.097804    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxxr\" (UniqueName: \"kubernetes.io/projected/1e5cbec8-f2d5-460a-9295-8abce2fa6129-kube-api-access-xvxxr\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:09.097859 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.097814    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1-kube-api-access-bvndp\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:09.837926 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.837892    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e5cbec8-f2d5-460a-9295-8abce2fa6129" path="/var/lib/kubelet/pods/1e5cbec8-f2d5-460a-9295-8abce2fa6129/volumes"
Sep 16 14:05:09.838293 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:09.838245    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" path="/var/lib/kubelet/pods/9ec09ec9-38d6-46b7-93ad-fdbe03d22af1/volumes"
Sep 16 14:05:16.098623 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.098585    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"]
Sep 16 14:05:16.099013 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099001    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e5cbec8-f2d5-460a-9295-8abce2fa6129" containerName="payload-processing"
Sep 16 14:05:16.099013 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099014    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5cbec8-f2d5-460a-9295-8abce2fa6129" containerName="payload-processing"
Sep 16 14:05:16.099092 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099028    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d8601b-b4af-4dcc-8d7e-003cd2ddb019" containerName="revoke-keys"
Sep 16 14:05:16.099092 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099033    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d8601b-b4af-4dcc-8d7e-003cd2ddb019" containerName="revoke-keys"
Sep 16 14:05:16.099092 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099045    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy"
Sep 16 14:05:16.099092 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099051    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy"
Sep 16 14:05:16.099092 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099056    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" containerName="payload-pre-processing"
Sep 16 14:05:16.099092 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099061    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" containerName="payload-pre-processing"
Sep 16 14:05:16.099269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099126    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d8601b-b4af-4dcc-8d7e-003cd2ddb019" containerName="revoke-keys"
Sep 16 14:05:16.099269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099133    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec09ec9-38d6-46b7-93ad-fdbe03d22af1" containerName="payload-pre-processing"
Sep 16 14:05:16.099269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099140    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy"
Sep 16 14:05:16.099269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099146    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy"
Sep 16 14:05:16.099269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.099151    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e5cbec8-f2d5-460a-9295-8abce2fa6129" containerName="payload-processing"
Sep 16 14:05:16.103585 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.103564    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:16.106569 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.106526    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-thk5m\""
Sep 16 14:05:16.112519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.112501    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"]
Sep 16 14:05:16.154196 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.154161    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0fe53f-d71a-4748-859a-db904f015ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9\" (UID: \"0f0fe53f-d71a-4748-859a-db904f015ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:16.255751 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.255711    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0fe53f-d71a-4748-859a-db904f015ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9\" (UID: \"0f0fe53f-d71a-4748-859a-db904f015ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:16.256425 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.256397    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0fe53f-d71a-4748-859a-db904f015ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9\" (UID: \"0f0fe53f-d71a-4748-859a-db904f015ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:16.416535 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.416453    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:16.711899 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:16.711874    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"]
Sep 16 14:05:16.713128 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:05:16.713101    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0fe53f_d71a_4748_859a_db904f015ce6.slice/crio-533abc94f6cd238e5ff0154a7f6185d8b511428081a20531973996eba828dcaf WatchSource:0}: Error finding container 533abc94f6cd238e5ff0154a7f6185d8b511428081a20531973996eba828dcaf: Status 404 returned error can't find the container with id 533abc94f6cd238e5ff0154a7f6185d8b511428081a20531973996eba828dcaf
Sep 16 14:05:17.058924 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:17.056024    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9" event={"ID":"0f0fe53f-d71a-4748-859a-db904f015ce6","Type":"ContainerStarted","Data":"533abc94f6cd238e5ff0154a7f6185d8b511428081a20531973996eba828dcaf"}
Sep 16 14:05:18.062780 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:18.062744    2552 generic.go:356] "Generic (PLEG): container finished" podID="0f0fe53f-d71a-4748-859a-db904f015ce6" containerID="3574a39e6cdeda1aae9e570d65f233f42fe31ae6df2b8d8fcba159368c13d599" exitCode=0
Sep 16 14:05:18.063215 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:18.062836    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9" event={"ID":"0f0fe53f-d71a-4748-859a-db904f015ce6","Type":"ContainerDied","Data":"3574a39e6cdeda1aae9e570d65f233f42fe31ae6df2b8d8fcba159368c13d599"}
Sep 16 14:05:19.201833 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:19.201806    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:19.281950 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:19.281924    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0fe53f-d71a-4748-859a-db904f015ce6-maas-api-service-ca\") pod \"0f0fe53f-d71a-4748-859a-db904f015ce6\" (UID: \"0f0fe53f-d71a-4748-859a-db904f015ce6\") "
Sep 16 14:05:19.282258 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:19.282234    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0fe53f-d71a-4748-859a-db904f015ce6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f0fe53f-d71a-4748-859a-db904f015ce6" (UID: "0f0fe53f-d71a-4748-859a-db904f015ce6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:19.383607 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:19.383510    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0fe53f-d71a-4748-859a-db904f015ce6-maas-api-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:20.074641 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:20.074607    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9" event={"ID":"0f0fe53f-d71a-4748-859a-db904f015ce6","Type":"ContainerDied","Data":"533abc94f6cd238e5ff0154a7f6185d8b511428081a20531973996eba828dcaf"}
Sep 16 14:05:20.074798 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:20.074651    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="533abc94f6cd238e5ff0154a7f6185d8b511428081a20531973996eba828dcaf"
Sep 16 14:05:20.074798 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:20.074678    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"
Sep 16 14:05:26.815740 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:26.815709    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"]
Sep 16 14:05:26.818649 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:26.818622    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-973610-29826120-dkjgg"]
Sep 16 14:05:26.864430 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:26.864398    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"]
Sep 16 14:05:26.864684 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:26.864657    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg" podUID="e189ec4c-39f6-4d45-8f09-f2fa16e43f78" containerName="payload-pre-processing" containerID="cri-o://eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda" gracePeriod=30
Sep 16 14:05:27.114944 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.114918    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 14:05:27.117195 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.117171    2552 generic.go:356] "Generic (PLEG): container finished" podID="e189ec4c-39f6-4d45-8f09-f2fa16e43f78" containerID="eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda" exitCode=0
Sep 16 14:05:27.117314 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.117203    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"
Sep 16 14:05:27.117314 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.117251    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg" event={"ID":"e189ec4c-39f6-4d45-8f09-f2fa16e43f78","Type":"ContainerDied","Data":"eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda"}
Sep 16 14:05:27.117314 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.117295    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg" event={"ID":"e189ec4c-39f6-4d45-8f09-f2fa16e43f78","Type":"ContainerDied","Data":"dac1f8bdd422aabacf3e8cb00229cb0016c8c754dad1a449634398adbb8b72ec"}
Sep 16 14:05:27.117421 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.117321    2552 scope.go:117] "RemoveContainer" containerID="eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda"
Sep 16 14:05:27.125435 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.125416    2552 scope.go:117] "RemoveContainer" containerID="eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda"
Sep 16 14:05:27.125740 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:27.125718    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda\": container with ID starting with eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda not found: ID does not exist" containerID="eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda"
Sep 16 14:05:27.125810 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.125749    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda"} err="failed to get container status \"eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda\": rpc error: code = NotFound desc = could not find container \"eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda\": container with ID starting with eadc8e48d39cb92b823ddf6bbd61c0e04c951cc67ea7bc0e838ce38dfb320dda not found: ID does not exist"
Sep 16 14:05:27.141141 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.141115    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"]
Sep 16 14:05:27.151139 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.151114    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-plugins-config-volume\") pod \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") "
Sep 16 14:05:27.151258 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.151165    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7xdr\" (UniqueName: \"kubernetes.io/projected/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-kube-api-access-s7xdr\") pod \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\" (UID: \"e189ec4c-39f6-4d45-8f09-f2fa16e43f78\") "
Sep 16 14:05:27.151526 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.151501    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e189ec4c-39f6-4d45-8f09-f2fa16e43f78" (UID: "e189ec4c-39f6-4d45-8f09-f2fa16e43f78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:27.151918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.151897    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:27.153950 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.153922    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-kube-api-access-s7xdr" (OuterVolumeSpecName: "kube-api-access-s7xdr") pod "e189ec4c-39f6-4d45-8f09-f2fa16e43f78" (UID: "e189ec4c-39f6-4d45-8f09-f2fa16e43f78"). InnerVolumeSpecName "kube-api-access-s7xdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:27.155259 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.155237    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-973610-7scv9"]
Sep 16 14:05:27.252439 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.252411    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7xdr\" (UniqueName: \"kubernetes.io/projected/e189ec4c-39f6-4d45-8f09-f2fa16e43f78-kube-api-access-s7xdr\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:27.446777 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.446747    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"]
Sep 16 14:05:27.451412 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.451383    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-973610-7d9bb9856b-j2rbg"]
Sep 16 14:05:27.837689 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.837659    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0fe53f-d71a-4748-859a-db904f015ce6" path="/var/lib/kubelet/pods/0f0fe53f-d71a-4748-859a-db904f015ce6/volumes"
Sep 16 14:05:27.838068 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.837968    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e680031-7d05-488e-bea6-5f4c1ae7ebb0" path="/var/lib/kubelet/pods/4e680031-7d05-488e-bea6-5f4c1ae7ebb0/volumes"
Sep 16 14:05:27.838258 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:27.838245    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e189ec4c-39f6-4d45-8f09-f2fa16e43f78" path="/var/lib/kubelet/pods/e189ec4c-39f6-4d45-8f09-f2fa16e43f78/volumes"
Sep 16 14:05:34.271606 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:34.271571    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"]
Sep 16 14:05:34.272060 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:34.271840    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy" containerID="cri-o://1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4" gracePeriod=30
Sep 16 14:05:39.521784 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.521755    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 14:05:39.657243 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657171    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-credential-socket\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657243 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657209    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-podinfo\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657243 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657241    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-token\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657258    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm57k\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-kube-api-access-gm57k\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657295    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-data\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657347    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-certs\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657410    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istiod-ca-cert\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657440    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-socket\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657519 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657468    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-envoy\") pod \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\" (UID: \"43c792cb-b867-4a1f-ae6c-47180b56e6fc\") "
Sep 16 14:05:39.657943 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657808    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:39.657943 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657856    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:39.657943 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.657923    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:39.658106 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.658021    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:39.658106 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.658043    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:39.659609 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.659584    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:39.659709 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.659578    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:05:39.659899 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.659883    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-kube-api-access-gm57k" (OuterVolumeSpecName: "kube-api-access-gm57k") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "kube-api-access-gm57k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:39.659961 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.659949    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43c792cb-b867-4a1f-ae6c-47180b56e6fc" (UID: "43c792cb-b867-4a1f-ae6c-47180b56e6fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:05:39.758777 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758754    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758777 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758774    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-envoy\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758783    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-credential-socket\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758792    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-podinfo\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758800    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-token\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758807    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm57k\" (UniqueName: \"kubernetes.io/projected/43c792cb-b867-4a1f-ae6c-47180b56e6fc-kube-api-access-gm57k\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758816    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istio-data\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758824    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c792cb-b867-4a1f-ae6c-47180b56e6fc-workload-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:39.758918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:39.758833    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c792cb-b867-4a1f-ae6c-47180b56e6fc-istiod-ca-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:40.187284 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.187250    2552 generic.go:356] "Generic (PLEG): container finished" podID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerID="1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4" exitCode=0
Sep 16 14:05:40.187472 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.187303    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"
Sep 16 14:05:40.187472 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.187330    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" event={"ID":"43c792cb-b867-4a1f-ae6c-47180b56e6fc","Type":"ContainerDied","Data":"1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4"}
Sep 16 14:05:40.187472 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.187391    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b" event={"ID":"43c792cb-b867-4a1f-ae6c-47180b56e6fc","Type":"ContainerDied","Data":"99e4521787b5e24a7625db1032655bee09803413652f42ddffe5d356afba4d33"}
Sep 16 14:05:40.187472 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.187414    2552 scope.go:117] "RemoveContainer" containerID="1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4"
Sep 16 14:05:40.196274 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.196256    2552 scope.go:117] "RemoveContainer" containerID="4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"
Sep 16 14:05:40.204008 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.203984    2552 scope.go:117] "RemoveContainer" containerID="1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4"
Sep 16 14:05:40.204276 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:40.204256    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4\": container with ID starting with 1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4 not found: ID does not exist" containerID="1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4"
Sep 16 14:05:40.204357 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.204289    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4"} err="failed to get container status \"1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4\": rpc error: code = NotFound desc = could not find container \"1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4\": container with ID starting with 1c2cdf2f6edad156f818b9ce5b850bc36033df0c5d2381706af1b5a18c071dc4 not found: ID does not exist"
Sep 16 14:05:40.204357 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.204313    2552 scope.go:117] "RemoveContainer" containerID="4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"
Sep 16 14:05:40.204622 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:40.204606    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724\": container with ID starting with 4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724 not found: ID does not exist" containerID="4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"
Sep 16 14:05:40.204688 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.204628    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724"} err="failed to get container status \"4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724\": rpc error: code = NotFound desc = could not find container \"4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724\": container with ID starting with 4c06eaf991ce79c2fdfd94cad7f6e929237870f043448835a448ab9de4ebd724 not found: ID does not exist"
Sep 16 14:05:40.209204 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.209174    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"]
Sep 16 14:05:40.211485 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:40.211458    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-973610-openshift-default-59d86896d4-bpf9b"]
Sep 16 14:05:41.837621 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:41.837592    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" path="/var/lib/kubelet/pods/43c792cb-b867-4a1f-ae6c-47180b56e6fc/volumes"
Sep 16 14:05:45.831454 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:45.831417    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"]
Sep 16 14:05:45.834045 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:45.834010    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw" podUID="6558e0b9-4251-48bb-b3f6-3b955fe8d940" containerName="payload-processing" containerID="cri-o://5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a" gracePeriod=30
Sep 16 14:05:45.875175 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:45.875144    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"]
Sep 16 14:05:45.875401 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:45.875377    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq" podUID="da3dbe10-5532-4fda-8e9d-52746bef7661" containerName="payload-pre-processing" containerID="cri-o://728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533" gracePeriod=30
Sep 16 14:05:46.125364 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.125310    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 14:05:46.153652 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.153623    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 14:05:46.213269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.213240    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6558e0b9-4251-48bb-b3f6-3b955fe8d940-plugins-config-volume\") pod \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") "
Sep 16 14:05:46.213438 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.213297    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sflg\" (UniqueName: \"kubernetes.io/projected/6558e0b9-4251-48bb-b3f6-3b955fe8d940-kube-api-access-9sflg\") pod \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\" (UID: \"6558e0b9-4251-48bb-b3f6-3b955fe8d940\") "
Sep 16 14:05:46.213680 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.213656    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6558e0b9-4251-48bb-b3f6-3b955fe8d940-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6558e0b9-4251-48bb-b3f6-3b955fe8d940" (UID: "6558e0b9-4251-48bb-b3f6-3b955fe8d940"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:46.215354 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.215327    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6558e0b9-4251-48bb-b3f6-3b955fe8d940-kube-api-access-9sflg" (OuterVolumeSpecName: "kube-api-access-9sflg") pod "6558e0b9-4251-48bb-b3f6-3b955fe8d940" (UID: "6558e0b9-4251-48bb-b3f6-3b955fe8d940"). InnerVolumeSpecName "kube-api-access-9sflg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:46.221066 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.221040    2552 generic.go:356] "Generic (PLEG): container finished" podID="da3dbe10-5532-4fda-8e9d-52746bef7661" containerID="728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533" exitCode=0
Sep 16 14:05:46.221155 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.221083    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"
Sep 16 14:05:46.221155 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.221090    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq" event={"ID":"da3dbe10-5532-4fda-8e9d-52746bef7661","Type":"ContainerDied","Data":"728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533"}
Sep 16 14:05:46.221155 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.221143    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq" event={"ID":"da3dbe10-5532-4fda-8e9d-52746bef7661","Type":"ContainerDied","Data":"0c3344da58c72c0ca861c1ab29b4c3d8a5c73c91b57490cb2c26c77e3b094b36"}
Sep 16 14:05:46.221321 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.221169    2552 scope.go:117] "RemoveContainer" containerID="728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533"
Sep 16 14:05:46.222652 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.222630    2552 generic.go:356] "Generic (PLEG): container finished" podID="6558e0b9-4251-48bb-b3f6-3b955fe8d940" containerID="5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a" exitCode=0
Sep 16 14:05:46.222742 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.222665    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw" event={"ID":"6558e0b9-4251-48bb-b3f6-3b955fe8d940","Type":"ContainerDied","Data":"5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a"}
Sep 16 14:05:46.222742 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.222688    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"
Sep 16 14:05:46.222829 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.222695    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw" event={"ID":"6558e0b9-4251-48bb-b3f6-3b955fe8d940","Type":"ContainerDied","Data":"07d551146506edf5fea36657b7bd3eb89fdf07308bfc445efe7b6f68da3990bd"}
Sep 16 14:05:46.230056 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.230039    2552 scope.go:117] "RemoveContainer" containerID="728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533"
Sep 16 14:05:46.230336 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:46.230315    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533\": container with ID starting with 728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533 not found: ID does not exist" containerID="728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533"
Sep 16 14:05:46.230402 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.230343    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533"} err="failed to get container status \"728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533\": rpc error: code = NotFound desc = could not find container \"728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533\": container with ID starting with 728e45787580d673135c4ab607e0b3ff65ac1ed97c789287dd3bfd48d335a533 not found: ID does not exist"
Sep 16 14:05:46.230402 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.230359    2552 scope.go:117] "RemoveContainer" containerID="5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a"
Sep 16 14:05:46.238766 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.238737    2552 scope.go:117] "RemoveContainer" containerID="5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a"
Sep 16 14:05:46.239053 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:05:46.239030    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a\": container with ID starting with 5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a not found: ID does not exist" containerID="5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a"
Sep 16 14:05:46.239117 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.239065    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a"} err="failed to get container status \"5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a\": rpc error: code = NotFound desc = could not find container \"5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a\": container with ID starting with 5d07d398fb12257ea794a09c6d0a706cb56bd113cbf2714ff3d4401b6a07ce1a not found: ID does not exist"
Sep 16 14:05:46.265949 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.265923    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"]
Sep 16 14:05:46.273215 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.273192    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8c36a6-78646b695f-jsdbw"]
Sep 16 14:05:46.314518 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.314487    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg7sr\" (UniqueName: \"kubernetes.io/projected/da3dbe10-5532-4fda-8e9d-52746bef7661-kube-api-access-bg7sr\") pod \"da3dbe10-5532-4fda-8e9d-52746bef7661\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") "
Sep 16 14:05:46.314724 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.314597    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3dbe10-5532-4fda-8e9d-52746bef7661-plugins-config-volume\") pod \"da3dbe10-5532-4fda-8e9d-52746bef7661\" (UID: \"da3dbe10-5532-4fda-8e9d-52746bef7661\") "
Sep 16 14:05:46.314960 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.314934    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6558e0b9-4251-48bb-b3f6-3b955fe8d940-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:46.315064 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.314961    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sflg\" (UniqueName: \"kubernetes.io/projected/6558e0b9-4251-48bb-b3f6-3b955fe8d940-kube-api-access-9sflg\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:46.315064 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.314998    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3dbe10-5532-4fda-8e9d-52746bef7661-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da3dbe10-5532-4fda-8e9d-52746bef7661" (UID: "da3dbe10-5532-4fda-8e9d-52746bef7661"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:05:46.316810 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.316783    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3dbe10-5532-4fda-8e9d-52746bef7661-kube-api-access-bg7sr" (OuterVolumeSpecName: "kube-api-access-bg7sr") pod "da3dbe10-5532-4fda-8e9d-52746bef7661" (UID: "da3dbe10-5532-4fda-8e9d-52746bef7661"). InnerVolumeSpecName "kube-api-access-bg7sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:05:46.416008 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.415924    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg7sr\" (UniqueName: \"kubernetes.io/projected/da3dbe10-5532-4fda-8e9d-52746bef7661-kube-api-access-bg7sr\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:46.416008 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.415950    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da3dbe10-5532-4fda-8e9d-52746bef7661-plugins-config-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:05:46.562495 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.562464    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"]
Sep 16 14:05:46.575455 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:46.575428    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c36a6-7465d56678-9lpbq"]
Sep 16 14:05:47.844877 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:47.844841    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6558e0b9-4251-48bb-b3f6-3b955fe8d940" path="/var/lib/kubelet/pods/6558e0b9-4251-48bb-b3f6-3b955fe8d940/volumes"
Sep 16 14:05:47.845226 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:47.845187    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da3dbe10-5532-4fda-8e9d-52746bef7661" path="/var/lib/kubelet/pods/da3dbe10-5532-4fda-8e9d-52746bef7661/volumes"
Sep 16 14:05:55.801400 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:55.801369    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 14:05:55.804740 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:05:55.804716    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 14:06:00.178637 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.178596    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-776hm"]
Sep 16 14:06:00.179080 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.178799    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b987c86d7-776hm" podUID="1bb85fdd-c001-4f33-b586-52de70118cdb" containerName="manager" containerID="cri-o://06b449d6d4ac1517f7a5eaf81ff46d4b8250aad4ac36609916375c3ef4207e0e" gracePeriod=30
Sep 16 14:06:00.293483 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.293457    2552 generic.go:356] "Generic (PLEG): container finished" podID="1bb85fdd-c001-4f33-b586-52de70118cdb" containerID="06b449d6d4ac1517f7a5eaf81ff46d4b8250aad4ac36609916375c3ef4207e0e" exitCode=0
Sep 16 14:06:00.293601 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.293563    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-776hm" event={"ID":"1bb85fdd-c001-4f33-b586-52de70118cdb","Type":"ContainerDied","Data":"06b449d6d4ac1517f7a5eaf81ff46d4b8250aad4ac36609916375c3ef4207e0e"}
Sep 16 14:06:00.421030 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.421006    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 14:06:00.535797 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.535771    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xl82\" (UniqueName: \"kubernetes.io/projected/1bb85fdd-c001-4f33-b586-52de70118cdb-kube-api-access-8xl82\") pod \"1bb85fdd-c001-4f33-b586-52de70118cdb\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") "
Sep 16 14:06:00.535953 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.535817    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-metrics-certs\") pod \"1bb85fdd-c001-4f33-b586-52de70118cdb\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") "
Sep 16 14:06:00.535953 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.535838    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-webhook-cert\") pod \"1bb85fdd-c001-4f33-b586-52de70118cdb\" (UID: \"1bb85fdd-c001-4f33-b586-52de70118cdb\") "
Sep 16 14:06:00.537895 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.537868    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb85fdd-c001-4f33-b586-52de70118cdb-kube-api-access-8xl82" (OuterVolumeSpecName: "kube-api-access-8xl82") pod "1bb85fdd-c001-4f33-b586-52de70118cdb" (UID: "1bb85fdd-c001-4f33-b586-52de70118cdb"). InnerVolumeSpecName "kube-api-access-8xl82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:06:00.538018 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.537866    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1bb85fdd-c001-4f33-b586-52de70118cdb" (UID: "1bb85fdd-c001-4f33-b586-52de70118cdb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:00.538018 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.537908    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1bb85fdd-c001-4f33-b586-52de70118cdb" (UID: "1bb85fdd-c001-4f33-b586-52de70118cdb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:06:00.636774 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.636745    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xl82\" (UniqueName: \"kubernetes.io/projected/1bb85fdd-c001-4f33-b586-52de70118cdb-kube-api-access-8xl82\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:06:00.636774 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.636770    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-metrics-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:06:00.636936 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:00.636786    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bb85fdd-c001-4f33-b586-52de70118cdb-webhook-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:06:01.300281 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:01.300246    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-776hm"
Sep 16 14:06:01.300767 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:01.300281    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-776hm" event={"ID":"1bb85fdd-c001-4f33-b586-52de70118cdb","Type":"ContainerDied","Data":"0406301d7f4d64e048ebe31169bb70279569c95d2a7d737404ea61ac6c639687"}
Sep 16 14:06:01.300767 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:01.300343    2552 scope.go:117] "RemoveContainer" containerID="06b449d6d4ac1517f7a5eaf81ff46d4b8250aad4ac36609916375c3ef4207e0e"
Sep 16 14:06:01.331363 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:01.331333    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-776hm"]
Sep 16 14:06:01.342443 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:01.342415    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-776hm"]
Sep 16 14:06:01.837285 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:01.837257    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb85fdd-c001-4f33-b586-52de70118cdb" path="/var/lib/kubelet/pods/1bb85fdd-c001-4f33-b586-52de70118cdb/volumes"
Sep 16 14:06:56.150201 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:06:56.150124    2552 scope.go:117] "RemoveContainer" containerID="9f841ed6eedd1fbbc8d70918c96704bc7c0950ee9f21a8b1181d68d610f40695"
Sep 16 14:07:02.190465 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.190433    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b987c86d7-48jjb"]
Sep 16 14:07:02.190995 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.190975    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e189ec4c-39f6-4d45-8f09-f2fa16e43f78" containerName="payload-pre-processing"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.190998    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e189ec4c-39f6-4d45-8f09-f2fa16e43f78" containerName="payload-pre-processing"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191011    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191019    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191035    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb85fdd-c001-4f33-b586-52de70118cdb" containerName="manager"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191043    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb85fdd-c001-4f33-b586-52de70118cdb" containerName="manager"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191060    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3dbe10-5532-4fda-8e9d-52746bef7661" containerName="payload-pre-processing"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191069    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3dbe10-5532-4fda-8e9d-52746bef7661" containerName="payload-pre-processing"
Sep 16 14:07:02.191076 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191078    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6558e0b9-4251-48bb-b3f6-3b955fe8d940" containerName="payload-processing"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191086    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6558e0b9-4251-48bb-b3f6-3b955fe8d940" containerName="payload-processing"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191109    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191119    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c443279-4d6e-4e16-8bde-c7be8f9e1703" containerName="istio-proxy"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191128    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0fe53f-d71a-4748-859a-db904f015ce6" containerName="revoke-keys"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191136    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0fe53f-d71a-4748-859a-db904f015ce6" containerName="revoke-keys"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191227    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb85fdd-c001-4f33-b586-52de70118cdb" containerName="manager"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191240    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3dbe10-5532-4fda-8e9d-52746bef7661" containerName="payload-pre-processing"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191250    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6558e0b9-4251-48bb-b3f6-3b955fe8d940" containerName="payload-processing"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191258    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e189ec4c-39f6-4d45-8f09-f2fa16e43f78" containerName="payload-pre-processing"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191268    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191277    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy"
Sep 16 14:07:02.191468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.191287    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f0fe53f-d71a-4748-859a-db904f015ce6" containerName="revoke-keys"
Sep 16 14:07:02.194447 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.194427    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.198646 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.198624    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 14:07:02.198646 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.198636    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 14:07:02.198811 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.198697    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p88z6\""
Sep 16 14:07:02.198811 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.198636    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 14:07:02.205593 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.205538    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-48jjb"]
Sep 16 14:07:02.342354 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.342330    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwbpf\" (UniqueName: \"kubernetes.io/projected/67007232-e850-4a5d-b5ea-423bddddbac9-kube-api-access-hwbpf\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.342520 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.342374    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-webhook-cert\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.342520 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.342402    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-metrics-certs\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.443420 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.443360    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-metrics-certs\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.443521 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.443423    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwbpf\" (UniqueName: \"kubernetes.io/projected/67007232-e850-4a5d-b5ea-423bddddbac9-kube-api-access-hwbpf\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.443521 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.443470    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-webhook-cert\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.445845 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.445815    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-webhook-cert\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.445962 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.445849    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-metrics-certs\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.451722 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.451702    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwbpf\" (UniqueName: \"kubernetes.io/projected/67007232-e850-4a5d-b5ea-423bddddbac9-kube-api-access-hwbpf\") pod \"maas-controller-5b987c86d7-48jjb\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") " pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.505110 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.505092    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:02.794090 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.794063    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-48jjb"]
Sep 16 14:07:02.797487 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:07:02.797462    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67007232_e850_4a5d_b5ea_423bddddbac9.slice/crio-ab3cb5b1dd6a15cc5f463cbace270d3766fa8505aae897d107b5253c810ba973 WatchSource:0}: Error finding container ab3cb5b1dd6a15cc5f463cbace270d3766fa8505aae897d107b5253c810ba973: Status 404 returned error can't find the container with id ab3cb5b1dd6a15cc5f463cbace270d3766fa8505aae897d107b5253c810ba973
Sep 16 14:07:02.798814 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:02.798795    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:07:03.599269 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:03.599235    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-48jjb" event={"ID":"67007232-e850-4a5d-b5ea-423bddddbac9","Type":"ContainerStarted","Data":"ab3cb5b1dd6a15cc5f463cbace270d3766fa8505aae897d107b5253c810ba973"}
Sep 16 14:07:07.619980 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:07.619941    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-48jjb" event={"ID":"67007232-e850-4a5d-b5ea-423bddddbac9","Type":"ContainerStarted","Data":"c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b"}
Sep 16 14:07:07.620474 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:07.620082    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:07.645413 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:07.645369    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b987c86d7-48jjb" podStartSLOduration=1.241986585 podStartE2EDuration="5.645354678s" totalImagesPullingTime="4.403368093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:07:07.643022418 +0000 UTC m=+2172.396712540" watchObservedRunningTime="2026-09-16 14:07:07.645354678 +0000 UTC m=+2172.399044852"
Sep 16 14:07:18.626612 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:18.626584    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:25.868106 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:25.868070    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-48jjb"]
Sep 16 14:07:25.868560 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:25.868297    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b987c86d7-48jjb" podUID="67007232-e850-4a5d-b5ea-423bddddbac9" containerName="manager" containerID="cri-o://c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b" gracePeriod=30
Sep 16 14:07:26.113812 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.113791    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:26.227218 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.227144    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-webhook-cert\") pod \"67007232-e850-4a5d-b5ea-423bddddbac9\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") "
Sep 16 14:07:26.227218 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.227187    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwbpf\" (UniqueName: \"kubernetes.io/projected/67007232-e850-4a5d-b5ea-423bddddbac9-kube-api-access-hwbpf\") pod \"67007232-e850-4a5d-b5ea-423bddddbac9\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") "
Sep 16 14:07:26.227218 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.227219    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-metrics-certs\") pod \"67007232-e850-4a5d-b5ea-423bddddbac9\" (UID: \"67007232-e850-4a5d-b5ea-423bddddbac9\") "
Sep 16 14:07:26.229139 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.229116    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "67007232-e850-4a5d-b5ea-423bddddbac9" (UID: "67007232-e850-4a5d-b5ea-423bddddbac9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:07:26.229274 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.229254    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67007232-e850-4a5d-b5ea-423bddddbac9-kube-api-access-hwbpf" (OuterVolumeSpecName: "kube-api-access-hwbpf") pod "67007232-e850-4a5d-b5ea-423bddddbac9" (UID: "67007232-e850-4a5d-b5ea-423bddddbac9"). InnerVolumeSpecName "kube-api-access-hwbpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:07:26.229325 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.229284    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "67007232-e850-4a5d-b5ea-423bddddbac9" (UID: "67007232-e850-4a5d-b5ea-423bddddbac9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:07:26.328731 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.328707    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-webhook-cert\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:07:26.328731 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.328729    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwbpf\" (UniqueName: \"kubernetes.io/projected/67007232-e850-4a5d-b5ea-423bddddbac9-kube-api-access-hwbpf\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:07:26.328871 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.328740    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67007232-e850-4a5d-b5ea-423bddddbac9-metrics-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:07:26.715888 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.715855    2552 generic.go:356] "Generic (PLEG): container finished" podID="67007232-e850-4a5d-b5ea-423bddddbac9" containerID="c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b" exitCode=0
Sep 16 14:07:26.715888 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.715897    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-48jjb"
Sep 16 14:07:26.716205 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.715930    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-48jjb" event={"ID":"67007232-e850-4a5d-b5ea-423bddddbac9","Type":"ContainerDied","Data":"c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b"}
Sep 16 14:07:26.716205 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.715992    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-48jjb" event={"ID":"67007232-e850-4a5d-b5ea-423bddddbac9","Type":"ContainerDied","Data":"ab3cb5b1dd6a15cc5f463cbace270d3766fa8505aae897d107b5253c810ba973"}
Sep 16 14:07:26.716205 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.716016    2552 scope.go:117] "RemoveContainer" containerID="c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b"
Sep 16 14:07:26.725708 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.725686    2552 scope.go:117] "RemoveContainer" containerID="c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b"
Sep 16 14:07:26.726040 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:07:26.726021    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b\": container with ID starting with c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b not found: ID does not exist" containerID="c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b"
Sep 16 14:07:26.726123 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.726047    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b"} err="failed to get container status \"c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b\": rpc error: code = NotFound desc = could not find container \"c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b\": container with ID starting with c25b39d6e4abe8727139551665633ad308cddf482cc2d1c96cf2e963fc7abd8b not found: ID does not exist"
Sep 16 14:07:26.740229 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.740209    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-48jjb"]
Sep 16 14:07:26.745148 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:26.745125    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-48jjb"]
Sep 16 14:07:27.559401 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.559366    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b987c86d7-zv7zs"]
Sep 16 14:07:27.559925 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.559904    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67007232-e850-4a5d-b5ea-423bddddbac9" containerName="manager"
Sep 16 14:07:27.559991 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.559931    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="67007232-e850-4a5d-b5ea-423bddddbac9" containerName="manager"
Sep 16 14:07:27.559991 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.559954    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy"
Sep 16 14:07:27.559991 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.559962    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c792cb-b867-4a1f-ae6c-47180b56e6fc" containerName="istio-proxy"
Sep 16 14:07:27.560098 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.560024    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="67007232-e850-4a5d-b5ea-423bddddbac9" containerName="manager"
Sep 16 14:07:27.564445 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.564428    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.569186 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.569159    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 14:07:27.569186 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.569170    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 14:07:27.569326 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.569262    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p88z6\""
Sep 16 14:07:27.569326 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.569284    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 14:07:27.573390 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.573367    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-zv7zs"]
Sep 16 14:07:27.639741 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.639713    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw2ck\" (UniqueName: \"kubernetes.io/projected/95fcc493-f624-48a0-97fe-e52d75b9f7c1-kube-api-access-zw2ck\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.639886 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.639753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95fcc493-f624-48a0-97fe-e52d75b9f7c1-metrics-certs\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.639886 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.639783    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95fcc493-f624-48a0-97fe-e52d75b9f7c1-webhook-cert\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.740767 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.740735    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw2ck\" (UniqueName: \"kubernetes.io/projected/95fcc493-f624-48a0-97fe-e52d75b9f7c1-kube-api-access-zw2ck\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.740904 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.740793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95fcc493-f624-48a0-97fe-e52d75b9f7c1-metrics-certs\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.740904 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.740843    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95fcc493-f624-48a0-97fe-e52d75b9f7c1-webhook-cert\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.743190 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.743166    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95fcc493-f624-48a0-97fe-e52d75b9f7c1-webhook-cert\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.743298 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.743166    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95fcc493-f624-48a0-97fe-e52d75b9f7c1-metrics-certs\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.751104 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.751081    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw2ck\" (UniqueName: \"kubernetes.io/projected/95fcc493-f624-48a0-97fe-e52d75b9f7c1-kube-api-access-zw2ck\") pod \"maas-controller-5b987c86d7-zv7zs\" (UID: \"95fcc493-f624-48a0-97fe-e52d75b9f7c1\") " pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:27.837702 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.837634    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67007232-e850-4a5d-b5ea-423bddddbac9" path="/var/lib/kubelet/pods/67007232-e850-4a5d-b5ea-423bddddbac9/volumes"
Sep 16 14:07:27.875962 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:27.875924    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:28.149719 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:28.149688    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b987c86d7-zv7zs"]
Sep 16 14:07:28.151230 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:07:28.151197    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fcc493_f624_48a0_97fe_e52d75b9f7c1.slice/crio-901b177d75bf01d2c5734bb03cfa78ba38efb986e65036ee13dd125510d9e42e WatchSource:0}: Error finding container 901b177d75bf01d2c5734bb03cfa78ba38efb986e65036ee13dd125510d9e42e: Status 404 returned error can't find the container with id 901b177d75bf01d2c5734bb03cfa78ba38efb986e65036ee13dd125510d9e42e
Sep 16 14:07:28.727359 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:28.727323    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-zv7zs" event={"ID":"95fcc493-f624-48a0-97fe-e52d75b9f7c1","Type":"ContainerStarted","Data":"901b177d75bf01d2c5734bb03cfa78ba38efb986e65036ee13dd125510d9e42e"}
Sep 16 14:07:32.747738 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:32.747654    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b987c86d7-zv7zs" event={"ID":"95fcc493-f624-48a0-97fe-e52d75b9f7c1","Type":"ContainerStarted","Data":"60da8ad6aa4863ad95124482b3148d094b92ea7dcaec2b34937f08b30a9af967"}
Sep 16 14:07:32.747738 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:32.747718    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:07:32.769492 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:32.769449    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b987c86d7-zv7zs" podStartSLOduration=1.5273004669999999 podStartE2EDuration="5.769433071s" totalImagesPullingTime="4.242132604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:07:32.768095929 +0000 UTC m=+2197.521786050" watchObservedRunningTime="2026-09-16 14:07:32.769433071 +0000 UTC m=+2197.523123192"
Sep 16 14:07:43.755385 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:07:43.755349    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b987c86d7-zv7zs"
Sep 16 14:08:39.760866 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:39.760829    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"]
Sep 16 14:08:39.761334 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:39.761043    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh" podUID="f2689c0f-ce49-4897-bd88-4bcf163f56a8" containerName="manager" containerID="cri-o://23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156" gracePeriod=10
Sep 16 14:08:40.208083 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.208059    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 14:08:40.341736 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.341663    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2689c0f-ce49-4897-bd88-4bcf163f56a8-extensions-socket-volume\") pod \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") "
Sep 16 14:08:40.341736 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.341702    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2kz7\" (UniqueName: \"kubernetes.io/projected/f2689c0f-ce49-4897-bd88-4bcf163f56a8-kube-api-access-x2kz7\") pod \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\" (UID: \"f2689c0f-ce49-4897-bd88-4bcf163f56a8\") "
Sep 16 14:08:40.342022 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.341996    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2689c0f-ce49-4897-bd88-4bcf163f56a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2689c0f-ce49-4897-bd88-4bcf163f56a8" (UID: "f2689c0f-ce49-4897-bd88-4bcf163f56a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:08:40.343750 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.343729    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2689c0f-ce49-4897-bd88-4bcf163f56a8-kube-api-access-x2kz7" (OuterVolumeSpecName: "kube-api-access-x2kz7") pod "f2689c0f-ce49-4897-bd88-4bcf163f56a8" (UID: "f2689c0f-ce49-4897-bd88-4bcf163f56a8"). InnerVolumeSpecName "kube-api-access-x2kz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:08:40.442447 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.442424    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2689c0f-ce49-4897-bd88-4bcf163f56a8-extensions-socket-volume\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:08:40.442447 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:40.442444    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2kz7\" (UniqueName: \"kubernetes.io/projected/f2689c0f-ce49-4897-bd88-4bcf163f56a8-kube-api-access-x2kz7\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:08:41.080500 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.080460    2552 generic.go:356] "Generic (PLEG): container finished" podID="f2689c0f-ce49-4897-bd88-4bcf163f56a8" containerID="23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156" exitCode=0
Sep 16 14:08:41.080919 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.080510    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"
Sep 16 14:08:41.080919 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.080519    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh" event={"ID":"f2689c0f-ce49-4897-bd88-4bcf163f56a8","Type":"ContainerDied","Data":"23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156"}
Sep 16 14:08:41.080919 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.080607    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh" event={"ID":"f2689c0f-ce49-4897-bd88-4bcf163f56a8","Type":"ContainerDied","Data":"315b61ff86a5b9a44c2f81e48572f6fd2a88563f3406febe9684eaf7da9393cc"}
Sep 16 14:08:41.080919 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.080640    2552 scope.go:117] "RemoveContainer" containerID="23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156"
Sep 16 14:08:41.090160 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.090133    2552 scope.go:117] "RemoveContainer" containerID="23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156"
Sep 16 14:08:41.090414 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:08:41.090396    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156\": container with ID starting with 23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156 not found: ID does not exist" containerID="23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156"
Sep 16 14:08:41.090467 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.090426    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156"} err="failed to get container status \"23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156\": rpc error: code = NotFound desc = could not find container \"23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156\": container with ID starting with 23a69cd4168b6c1c56a53361bb5dbb912a04f9768f2855b6f76f168d27c8a156 not found: ID does not exist"
Sep 16 14:08:41.106463 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.106442    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"]
Sep 16 14:08:41.114448 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.114427    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xp5gh"]
Sep 16 14:08:41.838637 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:08:41.838607    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2689c0f-ce49-4897-bd88-4bcf163f56a8" path="/var/lib/kubelet/pods/f2689c0f-ce49-4897-bd88-4bcf163f56a8/volumes"
Sep 16 14:09:40.525300 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.525266    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"]
Sep 16 14:09:40.525733 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.525639    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2689c0f-ce49-4897-bd88-4bcf163f56a8" containerName="manager"
Sep 16 14:09:40.525733 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.525651    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2689c0f-ce49-4897-bd88-4bcf163f56a8" containerName="manager"
Sep 16 14:09:40.525733 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.525713    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2689c0f-ce49-4897-bd88-4bcf163f56a8" containerName="manager"
Sep 16 14:09:40.528808 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.528792    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.532705 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.532685    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-677kh\""
Sep 16 14:09:40.552004 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.551982    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"]
Sep 16 14:09:40.633879 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.633855    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e1be767-23c5-46b0-8e70-035727e5335d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-srn8k\" (UID: \"0e1be767-23c5-46b0-8e70-035727e5335d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.634014 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.633898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnz5m\" (UniqueName: \"kubernetes.io/projected/0e1be767-23c5-46b0-8e70-035727e5335d-kube-api-access-wnz5m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-srn8k\" (UID: \"0e1be767-23c5-46b0-8e70-035727e5335d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.735120 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.735089    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e1be767-23c5-46b0-8e70-035727e5335d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-srn8k\" (UID: \"0e1be767-23c5-46b0-8e70-035727e5335d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.735240 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.735135    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnz5m\" (UniqueName: \"kubernetes.io/projected/0e1be767-23c5-46b0-8e70-035727e5335d-kube-api-access-wnz5m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-srn8k\" (UID: \"0e1be767-23c5-46b0-8e70-035727e5335d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.735466 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.735449    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e1be767-23c5-46b0-8e70-035727e5335d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-srn8k\" (UID: \"0e1be767-23c5-46b0-8e70-035727e5335d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.749371 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.749343    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnz5m\" (UniqueName: \"kubernetes.io/projected/0e1be767-23c5-46b0-8e70-035727e5335d-kube-api-access-wnz5m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-srn8k\" (UID: \"0e1be767-23c5-46b0-8e70-035727e5335d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:40.839488 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:40.839435    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:41.135598 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:41.135576    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"]
Sep 16 14:09:41.140524 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:09:41.140498    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1be767_23c5_46b0_8e70_035727e5335d.slice/crio-06106b7bd8c5facaba4e997214b276ebf43cf32aa6179c786887842c5137b04c WatchSource:0}: Error finding container 06106b7bd8c5facaba4e997214b276ebf43cf32aa6179c786887842c5137b04c: Status 404 returned error can't find the container with id 06106b7bd8c5facaba4e997214b276ebf43cf32aa6179c786887842c5137b04c
Sep 16 14:09:41.373845 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:41.373810    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k" event={"ID":"0e1be767-23c5-46b0-8e70-035727e5335d","Type":"ContainerStarted","Data":"fc8be6524df8ba429aad030eb7e3276ad2a045c16caebbafcf02479de128c4c5"}
Sep 16 14:09:41.374018 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:41.373860    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k" event={"ID":"0e1be767-23c5-46b0-8e70-035727e5335d","Type":"ContainerStarted","Data":"06106b7bd8c5facaba4e997214b276ebf43cf32aa6179c786887842c5137b04c"}
Sep 16 14:09:41.374018 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:41.373916    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:41.412766 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:41.412682    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k" podStartSLOduration=1.4126676169999999 podStartE2EDuration="1.412667617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:09:41.405722994 +0000 UTC m=+2326.159413152" watchObservedRunningTime="2026-09-16 14:09:41.412667617 +0000 UTC m=+2326.166357737"
Sep 16 14:09:52.381468 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:52.381385    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-srn8k"
Sep 16 14:09:56.195639 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:09:56.195607    2552 scope.go:117] "RemoveContainer" containerID="23c6b781b5c0084add4d4dfbcf2e758a858a9c72b42b3afb54f7c9395120b607"
Sep 16 14:10:55.830023 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:10:55.829994    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 14:10:55.834856 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:10:55.834836    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz9sf_a2dc6ee0-6238-4905-91b8-e77664b202bf/ovn-acl-logging/0.log"
Sep 16 14:11:20.496538 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.496448    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"]
Sep 16 14:11:20.500168 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.500138    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.504253 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.504228    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wb4dz\""
Sep 16 14:11:20.504384 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.504228    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 14:11:20.504384 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.504275    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:11:20.513002 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.512979    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"]
Sep 16 14:11:20.578752 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.578720    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e965e472-0a4f-4fae-838e-9d0ce63ccc31-openshift-service-ca\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.578908 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.578774    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-metrics-certs\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.578908 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.578860    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-maas-api-tls\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.578908 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.578900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg77c\" (UniqueName: \"kubernetes.io/projected/e965e472-0a4f-4fae-838e-9d0ce63ccc31-kube-api-access-cg77c\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.679384 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.679355    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e965e472-0a4f-4fae-838e-9d0ce63ccc31-openshift-service-ca\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.679575 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.679414    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-metrics-certs\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.679575 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.679462    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-maas-api-tls\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.679575 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.679498    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg77c\" (UniqueName: \"kubernetes.io/projected/e965e472-0a4f-4fae-838e-9d0ce63ccc31-kube-api-access-cg77c\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.680129 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.680109    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e965e472-0a4f-4fae-838e-9d0ce63ccc31-openshift-service-ca\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.681952 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.681935    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-maas-api-tls\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.682027 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.681974    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-metrics-certs\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.688011 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.687990    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg77c\" (UniqueName: \"kubernetes.io/projected/e965e472-0a4f-4fae-838e-9d0ce63ccc31-kube-api-access-cg77c\") pod \"maas-api-f5f7c95d8-jvw6b\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") " pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:20.810675 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:20.810651    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:21.088592 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:21.088568    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"]
Sep 16 14:11:21.090217 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:11:21.090187    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode965e472_0a4f_4fae_838e_9d0ce63ccc31.slice/crio-95aebe95db47ff5a6020d12bb402e5cbf8860876498325a38a7d6e80eeda2da0 WatchSource:0}: Error finding container 95aebe95db47ff5a6020d12bb402e5cbf8860876498325a38a7d6e80eeda2da0: Status 404 returned error can't find the container with id 95aebe95db47ff5a6020d12bb402e5cbf8860876498325a38a7d6e80eeda2da0
Sep 16 14:11:21.849093 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:21.849054    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b" event={"ID":"e965e472-0a4f-4fae-838e-9d0ce63ccc31","Type":"ContainerStarted","Data":"95aebe95db47ff5a6020d12bb402e5cbf8860876498325a38a7d6e80eeda2da0"}
Sep 16 14:11:24.864833 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:24.864801    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b" event={"ID":"e965e472-0a4f-4fae-838e-9d0ce63ccc31","Type":"ContainerStarted","Data":"e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e"}
Sep 16 14:11:24.865150 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:24.864936    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:24.889262 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:24.889220    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b" podStartSLOduration=1.258820549 podStartE2EDuration="4.889207199s" totalImagesPullingTime="3.63038665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:11:24.886498192 +0000 UTC m=+2429.640188318" watchObservedRunningTime="2026-09-16 14:11:24.889207199 +0000 UTC m=+2429.642897320"
Sep 16 14:11:28.377539 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.377503    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"]
Sep 16 14:11:28.378019 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.377693    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b" podUID="e965e472-0a4f-4fae-838e-9d0ce63ccc31" containerName="maas-api" containerID="cri-o://e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e" gracePeriod=30
Sep 16 14:11:28.618054 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.618031    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:28.754414 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.754326    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e965e472-0a4f-4fae-838e-9d0ce63ccc31-openshift-service-ca\") pod \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") "
Sep 16 14:11:28.754414 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.754370    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-maas-api-tls\") pod \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") "
Sep 16 14:11:28.754666 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.754458    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg77c\" (UniqueName: \"kubernetes.io/projected/e965e472-0a4f-4fae-838e-9d0ce63ccc31-kube-api-access-cg77c\") pod \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") "
Sep 16 14:11:28.754666 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.754493    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-metrics-certs\") pod \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\" (UID: \"e965e472-0a4f-4fae-838e-9d0ce63ccc31\") "
Sep 16 14:11:28.754782 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.754748    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e965e472-0a4f-4fae-838e-9d0ce63ccc31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e965e472-0a4f-4fae-838e-9d0ce63ccc31" (UID: "e965e472-0a4f-4fae-838e-9d0ce63ccc31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:11:28.754898 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.754872    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e965e472-0a4f-4fae-838e-9d0ce63ccc31-openshift-service-ca\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:11:28.756629 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.756605    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e965e472-0a4f-4fae-838e-9d0ce63ccc31-kube-api-access-cg77c" (OuterVolumeSpecName: "kube-api-access-cg77c") pod "e965e472-0a4f-4fae-838e-9d0ce63ccc31" (UID: "e965e472-0a4f-4fae-838e-9d0ce63ccc31"). InnerVolumeSpecName "kube-api-access-cg77c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:11:28.756731 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.756637    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e965e472-0a4f-4fae-838e-9d0ce63ccc31" (UID: "e965e472-0a4f-4fae-838e-9d0ce63ccc31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:11:28.756731 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.756662    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e965e472-0a4f-4fae-838e-9d0ce63ccc31" (UID: "e965e472-0a4f-4fae-838e-9d0ce63ccc31"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:11:28.855801 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.855777    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-maas-api-tls\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:11:28.855801 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.855798    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg77c\" (UniqueName: \"kubernetes.io/projected/e965e472-0a4f-4fae-838e-9d0ce63ccc31-kube-api-access-cg77c\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:11:28.855949 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.855808    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e965e472-0a4f-4fae-838e-9d0ce63ccc31-metrics-certs\") on node \"ip-10-0-129-205.ec2.internal\" DevicePath \"\""
Sep 16 14:11:28.886007 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.885982    2552 generic.go:356] "Generic (PLEG): container finished" podID="e965e472-0a4f-4fae-838e-9d0ce63ccc31" containerID="e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e" exitCode=0
Sep 16 14:11:28.886111 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.886023    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"
Sep 16 14:11:28.886111 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.886072    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b" event={"ID":"e965e472-0a4f-4fae-838e-9d0ce63ccc31","Type":"ContainerDied","Data":"e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e"}
Sep 16 14:11:28.886209 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.886120    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b" event={"ID":"e965e472-0a4f-4fae-838e-9d0ce63ccc31","Type":"ContainerDied","Data":"95aebe95db47ff5a6020d12bb402e5cbf8860876498325a38a7d6e80eeda2da0"}
Sep 16 14:11:28.886209 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.886143    2552 scope.go:117] "RemoveContainer" containerID="e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e"
Sep 16 14:11:28.895392 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.895374    2552 scope.go:117] "RemoveContainer" containerID="e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e"
Sep 16 14:11:28.895675 ip-10-0-129-205 kubenswrapper[2552]: E0916 14:11:28.895656    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e\": container with ID starting with e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e not found: ID does not exist" containerID="e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e"
Sep 16 14:11:28.895727 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.895684    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e"} err="failed to get container status \"e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e\": rpc error: code = NotFound desc = could not find container \"e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e\": container with ID starting with e1d3caaf2b64b5bd87d6f4c1fb21661bdd090eebd8d1fd393fa16f3073885e0e not found: ID does not exist"
Sep 16 14:11:28.909241 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.909219    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"]
Sep 16 14:11:28.913045 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:28.913025    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f5f7c95d8-jvw6b"]
Sep 16 14:11:29.838000 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:29.837969    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e965e472-0a4f-4fae-838e-9d0ce63ccc31" path="/var/lib/kubelet/pods/e965e472-0a4f-4fae-838e-9d0ce63ccc31/volumes"
Sep 16 14:11:56.222135 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:56.222098    2552 scope.go:117] "RemoveContainer" containerID="3574a39e6cdeda1aae9e570d65f233f42fe31ae6df2b8d8fcba159368c13d599"
Sep 16 14:11:56.654041 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:56.654014    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b987c86d7-zv7zs_95fcc493-f624-48a0-97fe-e52d75b9f7c1/manager/0.log"
Sep 16 14:11:56.768407 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:56.768374    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t7mcf_b4b3e934-430f-473a-a119-6fbe46045bba/server/0.log"
Sep 16 14:11:56.897999 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:56.897970    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qhwv6_e4fa8c1d-eda0-49ad-bf37-4235619cabbf/manager/0.log"
Sep 16 14:11:57.252792 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:57.252763    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdfbf9c59-blxwt_76e1afd2-3c5c-4e71-a013-53bf11ae860f/copy-manifests/0.log"
Sep 16 14:11:57.259990 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:57.259970    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdfbf9c59-blxwt_76e1afd2-3c5c-4e71-a013-53bf11ae860f/manager/0.log"
Sep 16 14:11:57.827373 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:57.827346    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826105-7862j_728ddd16-f145-4eb4-a6f1-05d16cca416b/cleanup/0.log"
Sep 16 14:11:58.047005 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:58.046977    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zmvc6_086f5664-b535-4b52-bcf1-35b585b0907c/postgres/0.log"
Sep 16 14:11:58.967898 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:58.967846    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-cdmx5_0f6fafbe-468a-4420-a615-47e7748d52f0/manager/0.log"
Sep 16 14:11:59.309650 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:11:59.309616    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-srn8k_0e1be767-23c5-46b0-8e70-035727e5335d/manager/0.log"
Sep 16 14:12:00.041893 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:00.041854    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wptls_be6598e1-7f38-4554-b886-b4ff67aa4f86/discovery/0.log"
Sep 16 14:12:00.155439 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:00.155403    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b66dcfb4c-2t28m_7117a2b0-e564-451b-a827-7e4587853047/kube-auth-proxy/0.log"
Sep 16 14:12:00.514825 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:00.514795    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zwf8d_9a230a65-c16a-47f7-a6d1-b2bdf21172ef/payload-pre-processing/0.log"
Sep 16 14:12:00.634303 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:00.634279    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9zkpq_7453cbbd-6a0d-4c00-9d10-72457dbdc457/payload-processing/0.log"
Sep 16 14:12:01.190774 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:01.190745    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x525r_c4355c98-8856-40bd-8c30-890fe9f38e8d/main/0.log"
Sep 16 14:12:01.302014 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:01.301974    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-vzqxg_397e7194-240e-4eec-adb4-34090dbec440/main/0.log"
Sep 16 14:12:01.642881 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:01.642851    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gg6pt_460ce62e-583c-4547-af7a-df2644724d9a/main/0.log"
Sep 16 14:12:11.866967 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:11.866935    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kzns5_8895c9fb-6858-4e65-8026-7bfe790ae660/global-pull-secret-syncer/0.log"
Sep 16 14:12:12.013599 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:12.013564    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gdt8m_c5ce7a17-adf6-4b5c-aa92-cee2f739c323/konnectivity-agent/0.log"
Sep 16 14:12:12.038218 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:12.038191    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-205.ec2.internal_e413a23ab9533a4b31565bf83d28336b/haproxy/0.log"
Sep 16 14:12:16.197901 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:16.197866    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-cdmx5_0f6fafbe-468a-4420-a615-47e7748d52f0/manager/0.log"
Sep 16 14:12:16.311760 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:16.311731    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-srn8k_0e1be767-23c5-46b0-8e70-035727e5335d/manager/0.log"
Sep 16 14:12:18.279295 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.279264    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qmhh_7b7158e9-9650-478b-a389-3fba66b81ca5/node-exporter/0.log"
Sep 16 14:12:18.299104 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.299083    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qmhh_7b7158e9-9650-478b-a389-3fba66b81ca5/kube-rbac-proxy/0.log"
Sep 16 14:12:18.320249 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.320226    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qmhh_7b7158e9-9650-478b-a389-3fba66b81ca5/init-textfile/0.log"
Sep 16 14:12:18.502691 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.502665    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rslvf_afbed6fe-85d8-4df4-a8a3-974946a6e161/kube-rbac-proxy-main/0.log"
Sep 16 14:12:18.540336 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.540310    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rslvf_afbed6fe-85d8-4df4-a8a3-974946a6e161/kube-rbac-proxy-self/0.log"
Sep 16 14:12:18.570692 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.570669    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rslvf_afbed6fe-85d8-4df4-a8a3-974946a6e161/openshift-state-metrics/0.log"
Sep 16 14:12:18.606176 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.606150    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/prometheus/0.log"
Sep 16 14:12:18.626351 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.626320    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/config-reloader/0.log"
Sep 16 14:12:18.648348 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.648325    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/thanos-sidecar/0.log"
Sep 16 14:12:18.667827 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.667807    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/kube-rbac-proxy-web/0.log"
Sep 16 14:12:18.689159 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.689126    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/kube-rbac-proxy/0.log"
Sep 16 14:12:18.710869 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.710818    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/kube-rbac-proxy-thanos/0.log"
Sep 16 14:12:18.731888 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.731871    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f9196236-83a8-4b5f-a4cd-9fea80b5d34b/init-config-reloader/0.log"
Sep 16 14:12:18.830782 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:18.830759    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-n6zqb_050ac75b-db86-4cae-bef9-e5bb4bf2adba/prometheus-operator-admission-webhook/0.log"
Sep 16 14:12:21.774994 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:21.774964    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86c8679bf9-zh495_5575490f-d00b-4e16-98ec-6aec0b5de309/console/0.log"
Sep 16 14:12:23.394994 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.394962    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"]
Sep 16 14:12:23.395355 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.395323    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e965e472-0a4f-4fae-838e-9d0ce63ccc31" containerName="maas-api"
Sep 16 14:12:23.395355 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.395335    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e965e472-0a4f-4fae-838e-9d0ce63ccc31" containerName="maas-api"
Sep 16 14:12:23.395432 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.395412    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e965e472-0a4f-4fae-838e-9d0ce63ccc31" containerName="maas-api"
Sep 16 14:12:23.398918 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.398897    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.401933 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.401917    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-skqhh\"/\"kube-root-ca.crt\""
Sep 16 14:12:23.402125 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.402114    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-skqhh\"/\"openshift-service-ca.crt\""
Sep 16 14:12:23.403252 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.403238    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-skqhh\"/\"default-dockercfg-x2b6g\""
Sep 16 14:12:23.406842 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.406821    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"]
Sep 16 14:12:23.509750 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.509728    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-lib-modules\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.509849 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.509775    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-sys\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.509849 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.509802    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52zkj\" (UniqueName: \"kubernetes.io/projected/94385136-d77b-4dfb-8444-2b9a4cd3082a-kube-api-access-52zkj\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.509849 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.509844    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-podres\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.509963 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.509865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-proc\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.610859 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610828    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-podres\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.610859 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610866    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-proc\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610889    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-lib-modules\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610938    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-sys\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610957    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-proc\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610972    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-podres\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.610963    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zkj\" (UniqueName: \"kubernetes.io/projected/94385136-d77b-4dfb-8444-2b9a4cd3082a-kube-api-access-52zkj\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611073 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.611034    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-sys\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.611428 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.611072    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94385136-d77b-4dfb-8444-2b9a4cd3082a-lib-modules\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.619895 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.619870    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52zkj\" (UniqueName: \"kubernetes.io/projected/94385136-d77b-4dfb-8444-2b9a4cd3082a-kube-api-access-52zkj\") pod \"perf-node-gather-daemonset-hq4vh\" (UID: \"94385136-d77b-4dfb-8444-2b9a4cd3082a\") " pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.690694 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.690625    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4f4bs_478a32c9-7492-4522-b9da-e91cf99cf25a/dns/0.log"
Sep 16 14:12:23.709323 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.709300    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:23.711300 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.711278    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4f4bs_478a32c9-7492-4522-b9da-e91cf99cf25a/kube-rbac-proxy/0.log"
Sep 16 14:12:23.875607 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.875581    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n67hz_aa33aaef-f00a-4bd4-995a-c695a7ab5cf1/dns-node-resolver/0.log"
Sep 16 14:12:23.981061 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:23.981039    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"]
Sep 16 14:12:23.982810 ip-10-0-129-205 kubenswrapper[2552]: W0916 14:12:23.982784    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94385136_d77b_4dfb_8444_2b9a4cd3082a.slice/crio-c4fa0c39879e1ebc3370fbe2de30e96237eaf6cbb3b5dbaafc2d3ade3e2bcb03 WatchSource:0}: Error finding container c4fa0c39879e1ebc3370fbe2de30e96237eaf6cbb3b5dbaafc2d3ade3e2bcb03: Status 404 returned error can't find the container with id c4fa0c39879e1ebc3370fbe2de30e96237eaf6cbb3b5dbaafc2d3ade3e2bcb03
Sep 16 14:12:24.141993 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:24.141961    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh" event={"ID":"94385136-d77b-4dfb-8444-2b9a4cd3082a","Type":"ContainerStarted","Data":"e2cf2ae87b325e908f0dd33747f2da10b2cb13e7c350c07617b2f75677a304ef"}
Sep 16 14:12:24.142128 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:24.142010    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh" event={"ID":"94385136-d77b-4dfb-8444-2b9a4cd3082a","Type":"ContainerStarted","Data":"c4fa0c39879e1ebc3370fbe2de30e96237eaf6cbb3b5dbaafc2d3ade3e2bcb03"}
Sep 16 14:12:24.142128 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:24.142076    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:24.162452 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:24.162411    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh" podStartSLOduration=1.162398706 podStartE2EDuration="1.162398706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:12:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:12:24.160806658 +0000 UTC m=+2488.914496779" watchObservedRunningTime="2026-09-16 14:12:24.162398706 +0000 UTC m=+2488.916088881"
Sep 16 14:12:24.458891 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:24.458862    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55569c5dd9-n75sc_5524210f-2353-4e38-8d9e-e134c1b119be/registry/0.log"
Sep 16 14:12:24.481586 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:24.481562    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dccn_0723d64e-668f-43fa-af2d-02f4cf0d5872/node-ca/0.log"
Sep 16 14:12:26.305880 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:26.305849    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wptls_be6598e1-7f38-4554-b886-b4ff67aa4f86/discovery/0.log"
Sep 16 14:12:26.327667 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:26.327635    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b66dcfb4c-2t28m_7117a2b0-e564-451b-a827-7e4587853047/kube-auth-proxy/0.log"
Sep 16 14:12:26.420782 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:26.420757    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zwf8d_9a230a65-c16a-47f7-a6d1-b2bdf21172ef/payload-pre-processing/0.log"
Sep 16 14:12:26.463640 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:26.463616    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9zkpq_7453cbbd-6a0d-4c00-9d10-72457dbdc457/payload-processing/0.log"
Sep 16 14:12:27.434902 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:27.434870    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tf9nf_f5f0ba5e-18be-4b34-9d17-d6b40a2edf4e/serve-healthcheck-canary/0.log"
Sep 16 14:12:28.077673 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:28.077644    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m2p2d_966482cc-216c-470c-9e41-65c04b936809/kube-rbac-proxy/0.log"
Sep 16 14:12:28.096511 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:28.096483    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m2p2d_966482cc-216c-470c-9e41-65c04b936809/exporter/0.log"
Sep 16 14:12:28.117008 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:28.116986    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m2p2d_966482cc-216c-470c-9e41-65c04b936809/extractor/0.log"
Sep 16 14:12:30.156940 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:30.156916    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-skqhh/perf-node-gather-daemonset-hq4vh"
Sep 16 14:12:30.799850 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:30.799816    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b987c86d7-zv7zs_95fcc493-f624-48a0-97fe-e52d75b9f7c1/manager/0.log"
Sep 16 14:12:30.863454 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:30.863433    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-t7mcf_b4b3e934-430f-473a-a119-6fbe46045bba/server/0.log"
Sep 16 14:12:31.015798 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:31.015767    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qhwv6_e4fa8c1d-eda0-49ad-bf37-4235619cabbf/manager/0.log"
Sep 16 14:12:31.267051 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:31.267019    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdfbf9c59-blxwt_76e1afd2-3c5c-4e71-a013-53bf11ae860f/manager/0.log"
Sep 16 14:12:31.287349 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:31.287325    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fdfbf9c59-blxwt_76e1afd2-3c5c-4e71-a013-53bf11ae860f/copy-manifests/0.log"
Sep 16 14:12:32.583139 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:32.583109    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wptls_be6598e1-7f38-4554-b886-b4ff67aa4f86/discovery/0.log"
Sep 16 14:12:32.596820 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:32.596793    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b66dcfb4c-2t28m_7117a2b0-e564-451b-a827-7e4587853047/kube-auth-proxy/0.log"
Sep 16 14:12:32.670580 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:32.670557    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zwf8d_9a230a65-c16a-47f7-a6d1-b2bdf21172ef/payload-pre-processing/0.log"
Sep 16 14:12:32.675224 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:32.675201    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-r9g4k_12d58816-f8b7-4ad1-b0eb-dfbd704e014a/openshift-lws-operator/0.log"
Sep 16 14:12:32.702379 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:32.702359    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9zkpq_7453cbbd-6a0d-4c00-9d10-72457dbdc457/payload-processing/0.log"
Sep 16 14:12:35.047703 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:35.047677    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wptls_be6598e1-7f38-4554-b886-b4ff67aa4f86/discovery/0.log"
Sep 16 14:12:35.097845 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:35.097811    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b66dcfb4c-2t28m_7117a2b0-e564-451b-a827-7e4587853047/kube-auth-proxy/0.log"
Sep 16 14:12:35.173884 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:35.173818    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zwf8d_9a230a65-c16a-47f7-a6d1-b2bdf21172ef/payload-pre-processing/0.log"
Sep 16 14:12:35.207392 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:35.207365    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9zkpq_7453cbbd-6a0d-4c00-9d10-72457dbdc457/payload-processing/0.log"
Sep 16 14:12:39.401699 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.401670    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/kube-multus-additional-cni-plugins/0.log"
Sep 16 14:12:39.421418 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.421397    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/egress-router-binary-copy/0.log"
Sep 16 14:12:39.447457 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.447438    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/cni-plugins/0.log"
Sep 16 14:12:39.466402 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.466384    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/bond-cni-plugin/0.log"
Sep 16 14:12:39.487179 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.487157    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/routeoverride-cni/0.log"
Sep 16 14:12:39.512238 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.512216    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/whereabouts-cni-bincopy/0.log"
Sep 16 14:12:39.533670 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.533645    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spfqx_0dd23045-d76e-4fbe-acdf-a186f3010925/whereabouts-cni/0.log"
Sep 16 14:12:39.801735 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.801711    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mjcf8_3b054665-a613-4bcb-a491-3a7c879297ae/kube-multus/0.log"
Sep 16 14:12:39.825941 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.825921    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bm6k9_8f057a5b-7478-4edf-95db-99245dd6bf3e/network-metrics-daemon/0.log"
Sep 16 14:12:39.844120 ip-10-0-129-205 kubenswrapper[2552]: I0916 14:12:39.844101    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bm6k9_8f057a5b-7478-4edf-95db-99245dd6bf3e/kube-rbac-proxy/0.log"