Sep 10 12:07:42.135388 ip-10-0-139-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 12:07:42.135399 ip-10-0-139-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 12:07:42.135406 ip-10-0-139-133 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 12:07:42.135642 ip-10-0-139-133 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 12:07:53.640284 ip-10-0-139-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 12:07:53.640301 ip-10-0-139-133 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7d37b2c9063547bd854dfde7416cf596 --
Sep 10 12:09:45.791746 ip-10-0-139-133 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 12:09:46.187799 ip-10-0-139-133 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 12:09:46.187799 ip-10-0-139-133 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 12:09:46.187799 ip-10-0-139-133 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 12:09:46.187799 ip-10-0-139-133 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 12:09:46.187799 ip-10-0-139-133 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 12:09:46.188455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.187861    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 12:09:46.193256 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193241    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:09:46.193256 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193255    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193259    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193262    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193265    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193269    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193271    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193274    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193277    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193280    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193283    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193285    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193288    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193290    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193294    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193297    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193299    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193303    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193305    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193308    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193310    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:09:46.193319 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193313    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193316    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193318    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193323    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193327    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193330    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193333    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193336    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193340    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193344    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193347    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193349    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193352    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193355    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193358    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193360    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193364    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193367    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193371    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:09:46.193982 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193374    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193376    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193379    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193382    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193385    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193387    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193390    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193392    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193395    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193397    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193400    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193402    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193405    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193407    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193410    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193414    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193417    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193419    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193422    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:09:46.194589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193438    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193441    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193444    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193447    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193449    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193452    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193516    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193533    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193538    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193543    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193547    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193552    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193556    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193561    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193566    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193570    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193575    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193579    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193590    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193594    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:09:46.195059 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.193598    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194355    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194361    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194365    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194369    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194374    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194378    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194384    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194389    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194393    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194398    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194469    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194495    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194503    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194601    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194607    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194612    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194615    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194618    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:09:46.195563 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.194620    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:09:46.196960 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196948    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:09:46.196960 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196960    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196964    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196967    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196970    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196974    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196976    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196979    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196982    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196986    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196988    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196991    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196994    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196996    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.196999    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197002    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197005    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197007    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197010    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197013    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197015    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:09:46.197016 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197018    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197021    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197024    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197027    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197030    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197033    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197035    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197038    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197040    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197043    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197046    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197049    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197051    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197054    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197057    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197059    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197062    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197065    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197069    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197073    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:09:46.197541 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197076    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197079    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197081    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197084    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197086    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197096    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197099    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197102    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197106    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197109    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197112    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197116    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197121    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197124    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197128    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197131    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197134    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197136    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197139    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:09:46.198042 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197142    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197144    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197147    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197150    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197152    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197154    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197157    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197160    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197162    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197165    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197168    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197170    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197173    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197175    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197178    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197180    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197183    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197185    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197188    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197190    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:09:46.198519 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197193    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197195    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197197    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197200    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197204    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197207    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197210    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197213    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197216    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197219    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197221    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197224    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197226    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197228    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197231    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197234    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197237    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197239    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197242    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:09:46.199035 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197630    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197636    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197639    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197642    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197646    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197649    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197652    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197656    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197660    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197664    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197667    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197670    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197673    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197676    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197679    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197682    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197684    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197687    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197690    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:09:46.199517 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197692    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197696    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197698    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197702    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197704    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197707    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197709    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197712    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197715    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197717    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197733    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197737    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197740    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197742    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197745    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197747    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197750    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197753    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197756    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:09:46.199983 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197758    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197761    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197763    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197766    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197768    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197771    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197773    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197776    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197778    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197781    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197786    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197789    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197792    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197794    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197797    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197800    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197802    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197805    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197807    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197810    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:09:46.200484 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197813    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197816    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197818    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197820    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197823    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197826    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197828    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197832    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197836    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197839    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197844    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197846    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197849    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197851    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197854    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197856    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197859    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197861    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197864    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197866    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:09:46.200969 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197869    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197871    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197874    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197877    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197880    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197882    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197885    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197888    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197890    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197893    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197895    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197898    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197901    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197903    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197905    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197908    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197910    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197913    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197915    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197918    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:09:46.201494 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.197920    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.197980    2557 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198014    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198025    2557 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198029    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198033    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198036    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198040    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198044    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198047    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198050    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198053    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198057    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198072    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198077    2557 flags.go:64] FLAG: --cgroup-root=""
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198080    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198084    2557 flags.go:64] FLAG: --client-ca-file=""
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198087    2557 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198090    2557 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198093    2557 flags.go:64] FLAG: --cluster-domain=""
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198096    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198099    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198103    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198106    2557 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 12:09:46.201998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198109    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198112    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198115    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198118    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198121    2557 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198124    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198127    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198131    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198133    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198137    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198141    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198144    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198147    2557 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198150    2557 flags.go:64] FLAG: --enable-server="true"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198153    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198157    2557 flags.go:64] FLAG: --event-burst="100"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198160    2557 flags.go:64] FLAG: --event-qps="50"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198164    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198167    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198170    2557 flags.go:64] FLAG: --eviction-hard=""
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198173    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198176    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198179    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198182    2557 flags.go:64] FLAG: --eviction-soft=""
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198185    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 12:09:46.202590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198188    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198190    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198193    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198196    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198199    2557 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198202    2557 flags.go:64] FLAG: --feature-gates=""
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198205    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198208    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198211    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198214    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198217    2557 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198220    2557 flags.go:64] FLAG: --help="false"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198222    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198225    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198228    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198231    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198234    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198238    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198241    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198244    2557 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198247    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198250    2557 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198252    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198255    2557 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 12:09:46.203204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198258    2557 flags.go:64] FLAG: --kube-reserved=""
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198261    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198264    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198267    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198270    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198273    2557 flags.go:64] FLAG: --lock-file=""
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198275    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198278    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198281    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198287    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198289    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198292    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198295    2557 flags.go:64] FLAG: --logging-format="text"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198298    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198301    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198304    2557 flags.go:64] FLAG: --manifest-url=""
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198306    2557 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198310    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198313    2557 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198317    2557 flags.go:64] FLAG: --max-pods="110"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198320    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198323    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198326    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198328    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198331    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 12:09:46.203808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198334    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198337    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198343    2557 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198346    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198349    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198352    2557 flags.go:64] FLAG: --pod-cidr=""
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198355    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198359    2557 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198362    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198365    2557 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198368    2557 flags.go:64] FLAG: --port="10250"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198371    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198374    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bf9b684afee4822b"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198377    2557 flags.go:64] FLAG: --qos-reserved=""
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198380    2557 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198383    2557 flags.go:64] FLAG: --register-node="true"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198385    2557 flags.go:64] FLAG: --register-with-taints=""
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198389    2557 flags.go:64] FLAG: --registry-burst="10"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198392    2557 flags.go:64] FLAG: --registry-qps="5"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198395    2557 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198398    2557 flags.go:64] FLAG: --reserved-memory=""
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198402    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198404    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198407    2557 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198410    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 12:09:46.204434 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198413    2557 flags.go:64] FLAG: --runonce="false"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198416    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198419    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198435    2557 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198439    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198442    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198445    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198448    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198451    2557 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198454    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198457    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198459    2557 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198462    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198465    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198468    2557 flags.go:64] FLAG: --system-cgroups=""
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198471    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198476    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198479    2557 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198482    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198487    2557 flags.go:64] FLAG: --tls-min-version=""
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198490    2557 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198493    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198495    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198498    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198501    2557 flags.go:64] FLAG: --v="2"
Sep 10 12:09:46.205044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198506    2557 flags.go:64] FLAG: --version="false"
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198509    2557 flags.go:64] FLAG: --vmodule=""
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198513    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.198516    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198618    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198622    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198625    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198628    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198632    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198634    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198637    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198640    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198643    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198647    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198650    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198653    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198655    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198659    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198661    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198664    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:09:46.205744 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198667    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198669    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198672    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198674    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198677    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198679    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198683    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198686    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198689    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198693    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198696    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198698    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198701    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198704    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198707    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198709    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198712    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198714    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198717    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:09:46.206243 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198719    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198722    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198724    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198727    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198729    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198732    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198735    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198738    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198741    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198743    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198746    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198748    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198751    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198754    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198756    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198759    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198762    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198764    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198767    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198770    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:09:46.206722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198773    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198775    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198778    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198780    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198783    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198787    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198790    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198795    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198799    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198802    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198805    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198808    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198810    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198814    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198816    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198819    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198821    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198824    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198828    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:09:46.207209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198830    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198841    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198844    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198846    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198849    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198851    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198854    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198856    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198859    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198861    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198864    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198866    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198870    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198873    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198875    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198878    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198880    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198883    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198886    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198888    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:09:46.207755 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198891    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198894    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198896    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198899    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.198901    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.199573    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.207058    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.207186    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.208012    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.208019    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208072    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208076    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208080    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208083    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208086    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:09:46.208238 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208089    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208092    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208095    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208098    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208101    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208104    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208107    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208109    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208112    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208117    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208120    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208124    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208126    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208129    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208131    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208135    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208137    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208140    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208144    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208146    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:09:46.208632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208149    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208151    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208155    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208159    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208163    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208166    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208169    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208172    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208175    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208177    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208180    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208183    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208185    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208188    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208190    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208193    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208196    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208199    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208201    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208204    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:09:46.209122 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208207    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208209    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208212    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208215    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208217    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208220    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208222    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208225    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208229    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208232    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208235    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208239    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208242    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208245    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208247    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208250    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208253    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208256    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208259    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:09:46.209615 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208262    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208265    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208268    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208270    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208273    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208275    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208278    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208280    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208283    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208286    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208288    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208291    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208293    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208296    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208298    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208301    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208303    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208306    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208308    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208311    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:09:46.210082 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208313    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208316    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208318    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208321    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208324    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208327    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208329    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208332    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208335    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208338    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208340    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208343    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208345    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208348    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208350    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:09:46.210591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.208355    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208470    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208475    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208479    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208483    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208486    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208489    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208492    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208495    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208497    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208500    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208502    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208505    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208507    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208510    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208512    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208515    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208517    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208520    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 12:09:46.210967 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208522    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208525    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208528    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208532    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208535    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208538    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208541    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208544    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208547    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208549    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208552    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208554    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208557    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208559    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208562    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208565    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208567    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208570    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208572    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208575    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 12:09:46.211440 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208577    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208580    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208582    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208585    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208587    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208590    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208592    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208595    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208597    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208600    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208602    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208605    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208607    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208610    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208612    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208615    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208618    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208628    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208631    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 12:09:46.211934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208633    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208636    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208639    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208642    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208645    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208647    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208651    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208654    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208656    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208659    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208661    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208664    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208666    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208669    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208671    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208674    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208676    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208679    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208681    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208684    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 12:09:46.212394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208686    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208689    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208691    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208694    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208696    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208699    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208701    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208704    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208706    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208709    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208711    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208714    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208717    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208720    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208722    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208725    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208727    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208730    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208732    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208735    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 12:09:46.212883 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208737    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:46.208739    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.208744    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.208839    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.210667    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.211584    2557 server.go:1019] "Starting client certificate rotation"
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.211678    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 12:09:46.213373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.211712    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 12:09:46.213775 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.213762    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 12:09:46.217788 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.217774    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 12:09:46.228078 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.228061    2557 log.go:25] "Validated CRI v1 runtime API"
Sep 10 12:09:46.230972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.230958    2557 log.go:25] "Validated CRI v1 image API"
Sep 10 12:09:46.231753 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.231737    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 12:09:46.234950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.234929    2557 fs.go:135] Filesystem UUIDs: map[3beeeb28-5512-4afb-ae0d-459c01880114:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bda88506-2e6b-47c2-9415-7f2902d8b1a4:/dev/nvme0n1p4]
Sep 10 12:09:46.235028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.234947    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 12:09:46.241287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.241177    2557 manager.go:216] Machine: {Timestamp:2026-09-10 12:09:46.23836015 +0000 UTC m=+0.332540337 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107082 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec227209695e532ef41554d74cfd239e SystemUUID:ec227209-695e-532e-f415-54d74cfd239e BootID:7d37b2c9-0635-47bd-854d-fde7416cf596 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:25:18:3b:f0:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:25:18:3b:f0:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:66:a6:40:b5:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 12:09:46.241287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.241277    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 12:09:46.241413 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.241380    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 12:09:46.244711 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.244682    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 12:09:46.244834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.244713    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 12:09:46.245488 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.245477    2557 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 12:09:46.245521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.245490    2557 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 12:09:46.245521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.245497    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 12:09:46.246452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.246441    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 12:09:46.247249 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.247240    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 12:09:46.251012 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251000    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 12:09:46.251123 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251114    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 12:09:46.251155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251146    2557 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 12:09:46.251183 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251167    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 12:09:46.251215 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251186    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 12:09:46.251215 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251197    2557 kubelet.go:398] "Adding apiserver pod source"
Sep 10 12:09:46.251215 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251205    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 12:09:46.251587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251575    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 12:09:46.251632 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.251598    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 12:09:46.253926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.253902    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 12:09:46.256119 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256106    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 12:09:46.256166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256135    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 12:09:46.256274 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256264    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 12:09:46.256320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256278    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 12:09:46.256320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256284    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 12:09:46.256320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256289    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 12:09:46.256320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256296    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 12:09:46.256320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256302    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 12:09:46.256810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256801    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 12:09:46.256810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256810    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 12:09:46.256871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256817    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 12:09:46.256871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256822    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 12:09:46.256871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256830    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 12:09:46.256871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.256837    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 12:09:46.257600 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.257583    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 12:09:46.257600 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.257598    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 12:09:46.261203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.261187    2557 server.go:1268] "Started kubelet"
Sep 10 12:09:46.264057 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.261289    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 12:09:46.264695 ip-10-0-139-133 systemd[1]: Started Kubernetes Kubelet.
Sep 10 12:09:46.264870 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.261282    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 12:09:46.264870 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.264760    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 12:09:46.265903 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.265876    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 12:09:46.268217 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.268198    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 12:09:46.268320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.268203    2557 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 12:09:46.268717 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.268628    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 12:09:46.270572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.270554    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 12:09:46.273368 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.273350    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 12:09:46.273619 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.273601    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 12:09:46.273962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.273945    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 12:09:46.274215 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.274194    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.274709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274686    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 12:09:46.274709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274687    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 12:09:46.274840 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274713    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 12:09:46.274840 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274763    2557 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 12:09:46.274840 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274772    2557 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 12:09:46.274981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274858    2557 factory.go:55] Registering systemd factory
Sep 10 12:09:46.274981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.274870    2557 factory.go:223] Registration of the systemd container factory successfully
Sep 10 12:09:46.275089 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.275075    2557 factory.go:153] Registering CRI-O factory
Sep 10 12:09:46.275143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.275091    2557 factory.go:223] Registration of the crio container factory successfully
Sep 10 12:09:46.275143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.275128    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 12:09:46.275143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.275142    2557 factory.go:103] Registering Raw factory
Sep 10 12:09:46.275287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.275155    2557 manager.go:1196] Started watching for new ooms in manager
Sep 10 12:09:46.275491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.275480    2557 manager.go:349] Starting recovery of all containers
Sep 10 12:09:46.284700 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.284673    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 12:09:46.284810 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.284735    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 12:09:46.284869 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.284810    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 12:09:46.285751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.285732    2557 manager.go:354] Recovery completed
Sep 10 12:09:46.286827 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.284725    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c048ebe3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.261162979 +0000 UTC m=+0.355343163,LastTimestamp:2026-09-10 12:09:46.261162979 +0000 UTC m=+0.355343163,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.290201 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.290186    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.293183 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.293159    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.293255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.293195    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.293255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.293209    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.294157 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.294144    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 12:09:46.294157 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.294157    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 12:09:46.294267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.294173    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 12:09:46.294267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.294192    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.295153 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.295132    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.295284 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.295273    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.295363 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.295354    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.295689 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.295147    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c23181cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.293182923 +0000 UTC m=+0.387363106,LastTimestamp:2026-09-10 12:09:46.293182923 +0000 UTC m=+0.387363106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.297818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.297803    2557 policy_none.go:49] "None policy: Start"
Sep 10 12:09:46.297885 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.297830    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 12:09:46.297885 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.297844    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 12:09:46.299768 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.299755    2557 policy_none.go:47] "Start"
Sep 10 12:09:46.301795 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.301742    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c231ce6d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.293202541 +0000 UTC m=+0.387382726,LastTimestamp:2026-09-10 12:09:46.293202541 +0000 UTC m=+0.387382726,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.305811 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.305753    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c231fb02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.293213954 +0000 UTC m=+0.387394138,LastTimestamp:2026-09-10 12:09:46.293213954 +0000 UTC m=+0.387394138,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.312508 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.312417    2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-133.ec2.internal.18d3f463c23181cb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c23181cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.293182923 +0000 UTC m=+0.387363106,LastTimestamp:2026-09-10 12:09:46.295246205 +0000 UTC m=+0.389426399,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.322850    2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-133.ec2.internal.18d3f463c231ce6d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c231ce6d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.293202541 +0000 UTC m=+0.387382726,LastTimestamp:2026-09-10 12:09:46.295344107 +0000 UTC m=+0.389524305,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.332949    2557 manager.go:337] "Starting Device Plugin manager"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.332977    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.332985    2557 server.go:87] "Starting device plugin registration server"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.333040    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2sj88"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.333211    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.333222    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.333349    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.333418    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.333441    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.333802    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.333849    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.335045    2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-133.ec2.internal.18d3f463c231fb02\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c231fb02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.293213954 +0000 UTC m=+0.387394138,LastTimestamp:2026-09-10 12:09:46.295414675 +0000 UTC m=+0.389594861,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.343830    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2sj88"
Sep 10 12:09:46.351606 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.347688    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18d3f463c4b7d1ae  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-09-10 12:09:46.33553963 +0000 UTC m=+0.429719800,LastTimestamp:2026-09-10 12:09:46.33553963 +0000 UTC m=+0.429719800,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}"
Sep 10 12:09:46.382133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.382108    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 12:09:46.383214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.383191    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 12:09:46.383289 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.383247    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 12:09:46.383289 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.383270    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 12:09:46.383384 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.383311    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 12:09:46.407269 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.407249    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:09:46.433325 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.433306    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.434136 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.434120    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.434261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.434153    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.434261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.434168    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.434261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.434197    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.453860 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.453798    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.453860 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.453820    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-133.ec2.internal\": node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.484340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.484316    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"]
Sep 10 12:09:46.484416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.484373    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.485135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.485121    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.485198 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.485144    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.485198 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.485155    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.487208 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487196    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.487333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487319    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.487373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487347    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.487860 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487846    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.487931 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487864    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.487931 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487876    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.487931 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487881    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.487931 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487890    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.488064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.487891    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.489950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.489936    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.490007 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.489960    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:46.490638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.490625    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:46.490705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.490648    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:46.490705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.490660    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:46.492244 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.492227    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.505957 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.505940    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.509661 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.509647    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.576184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.576166    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03c4761a17877d2c4ef55ddef5cde326-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"03c4761a17877d2c4ef55ddef5cde326\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.576254 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.576194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03c4761a17877d2c4ef55ddef5cde326-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"03c4761a17877d2c4ef55ddef5cde326\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.576254 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.576210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cecf6a195bd7af1b2519a96aa95ed769-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"cecf6a195bd7af1b2519a96aa95ed769\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.593279 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.593263    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.676374 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.676345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cecf6a195bd7af1b2519a96aa95ed769-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"cecf6a195bd7af1b2519a96aa95ed769\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.676374 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.676379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03c4761a17877d2c4ef55ddef5cde326-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"03c4761a17877d2c4ef55ddef5cde326\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.676525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.676394    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03c4761a17877d2c4ef55ddef5cde326-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"03c4761a17877d2c4ef55ddef5cde326\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.676525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.676419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cecf6a195bd7af1b2519a96aa95ed769-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"cecf6a195bd7af1b2519a96aa95ed769\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.676525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.676451    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03c4761a17877d2c4ef55ddef5cde326-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"03c4761a17877d2c4ef55ddef5cde326\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.676525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.676465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03c4761a17877d2c4ef55ddef5cde326-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"03c4761a17877d2c4ef55ddef5cde326\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.693472 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.693454    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.793956 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.793900    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.807971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.807954    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.812457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:46.812420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:46.894206 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.894183    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:46.994684 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:46.994657    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.095150 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.095099    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.195628 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.195600    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.210983 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.210958    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 12:09:47.211081 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.211005    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:09:47.211135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.211076    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 12:09:47.296184 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.296156    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.349458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.349372    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:04:47 +0000 UTC" deadline="2028-06-13 05:26:42.540434322 +0000 UTC"
Sep 10 12:09:47.349458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.349409    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15401h16m55.191028531s"
Sep 10 12:09:47.396467 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.396302    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.494255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.494223    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 12:09:47.495307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.495288    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 12:09:47.495390 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.495319    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 12:09:47.495390 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.495331    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID"
Sep 10 12:09:47.497479 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.497458    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.572716 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:47.572683    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c4761a17877d2c4ef55ddef5cde326.slice/crio-33c5558efc7b485dcb924148bfe1430f9f5847816855cfc8a0947125eb091e1c WatchSource:0}: Error finding container 33c5558efc7b485dcb924148bfe1430f9f5847816855cfc8a0947125eb091e1c: Status 404 returned error can't find the container with id 33c5558efc7b485dcb924148bfe1430f9f5847816855cfc8a0947125eb091e1c
Sep 10 12:09:47.573080 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:47.573059    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecf6a195bd7af1b2519a96aa95ed769.slice/crio-65dafd70947f84f41e075c25fc0b44be56f95038fc733c64d8ac0e2781fd8ff9 WatchSource:0}: Error finding container 65dafd70947f84f41e075c25fc0b44be56f95038fc733c64d8ac0e2781fd8ff9: Status 404 returned error can't find the container with id 65dafd70947f84f41e075c25fc0b44be56f95038fc733c64d8ac0e2781fd8ff9
Sep 10 12:09:47.577307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.577292    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:09:47.598386 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.598362    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.604527 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.604482    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:09:47.698910 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:47.698880    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found"
Sep 10 12:09:47.731247 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.731222    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:09:47.775354 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.775334    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:47.792681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.792662    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 12:09:47.793460 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.793447    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"
Sep 10 12:09:47.811840 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:47.811822    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 12:09:48.252861 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.252831    2557 apiserver.go:52] "Watching apiserver"
Sep 10 12:09:48.264231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.264203    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 12:09:48.264720 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.264693    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dmw2b","openshift-multus/network-metrics-daemon-4mcmv","openshift-network-diagnostics/network-check-target-cgl6b","kube-system/global-pull-secret-syncer-xn6sq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","openshift-multus/multus-xp9tb","openshift-network-operator/iptables-alerter-lmf29","openshift-ovn-kubernetes/ovnkube-node-59wst","kube-system/konnectivity-agent-cgxj9","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wl2hp","openshift-dns/node-resolver-kjkm6","openshift-image-registry/node-ca-wtncr"]
Sep 10 12:09:48.267402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.267378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.270068 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.270049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.272245 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.272222    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:48.272345 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.272292    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:09:48.274393 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.274373    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 12:09:48.274598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.274579    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 12:09:48.274669 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.274633    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 12:09:48.275007 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.274991    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-29jdx\""
Sep 10 12:09:48.275084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.275021    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.275193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.275172    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.275336 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.275318    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.275433 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.275378    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:09:48.276235 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.276044    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brggr\""
Sep 10 12:09:48.277489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.277028    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.277489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.277081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.278142 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.277780    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.279561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.279296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281174    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a9acddb-5d80-44e9-ae12-025daecdbc0e-kubelet-config\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281256    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-k8s-cni-cncf-io\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-hostroot\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281317    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-conf-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-registration-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281387    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-cni-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-cnibin\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-kubelet\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxw9b\" (UniqueName: \"kubernetes.io/projected/68d8fbe8-cab2-4389-a764-476d6b85683c-kube-api-access-sxw9b\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-cni-multus\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/991e1107-6aec-4eb1-bbca-cda61a517017-tmp-dir\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-socket-dir-parent\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281717    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-multus-certs\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.281820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-daemon-config\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vpgj\" (UniqueName: \"kubernetes.io/projected/991e1107-6aec-4eb1-bbca-cda61a517017-kube-api-access-7vpgj\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.281927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a9acddb-5d80-44e9-ae12-025daecdbc0e-dbus\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-sys-fs\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-system-cni-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-netns\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/991e1107-6aec-4eb1-bbca-cda61a517017-hosts-file\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-socket-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-device-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqvwp\" (UniqueName: \"kubernetes.io/projected/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-kube-api-access-rqvwp\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68d8fbe8-cab2-4389-a764-476d6b85683c-cni-binary-copy\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-cni-bin\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.282665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.282370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-etc-kubernetes\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.283981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.283841    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.285121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.284784    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.285374 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.285349    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 12:09:48.285476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.285349    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 12:09:48.285476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.285453    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mz2xh\""
Sep 10 12:09:48.285628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.285458    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.285697 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.285683    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.286637 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.286617    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.287671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.287604    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.288946 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.288925    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.289255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.289237    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.289620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.289401    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 12:09:48.289620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.289538    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 12:09:48.289922 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.289899    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 12:09:48.290189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.290171    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 12:09:48.290622 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.290485    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.290622 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.290561    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:09:48.291143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.291121    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-crvvv\""
Sep 10 12:09:48.292991 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.292950    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.293647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.293626    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pmxqr\""
Sep 10 12:09:48.293736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.293680    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r9rk5\""
Sep 10 12:09:48.293794 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.293757    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 12:09:48.293852 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.293800    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 12:09:48.295818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.295790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.298145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.298131    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.298251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.298174    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 12:09:48.298251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.298222    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 12:09:48.303520 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.303485    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6frm2\""
Sep 10 12:09:48.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.303759    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.303869    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:09:48.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.303760    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.304032    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s7b5q\""
Sep 10 12:09:48.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.304218    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 12:09:48.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.304231    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 12:09:48.304971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.304940    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8fdbx\""
Sep 10 12:09:48.321487 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.321464    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 12:09:48.375642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.375626    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 12:09:48.382568 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a9acddb-5d80-44e9-ae12-025daecdbc0e-kubelet-config\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.382665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382572    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-k8s-cni-cncf-io\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.382665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-hostroot\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.382776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382662    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-hostroot\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.382776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a9acddb-5d80-44e9-ae12-025daecdbc0e-kubelet-config\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.382776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382712    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-k8s-cni-cncf-io\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.382776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382724    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6aa15bd8-8bd6-4d32-95d3-c2a933917512-host\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.382776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6aa15bd8-8bd6-4d32-95d3-c2a933917512-serviceca\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.383037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.383037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382808    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovnkube-script-lib\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.383037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-system-cni-dir\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.383037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-modprobe-d\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.383037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.382966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.383037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-kubernetes\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.383342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysctl-d\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.383390 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-run\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.383428 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.383478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-cni-multus\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.383478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-socket-dir-parent\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.383578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-multus-certs\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.383690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqdfb\" (UniqueName: \"kubernetes.io/projected/6aa15bd8-8bd6-4d32-95d3-c2a933917512-kube-api-access-sqdfb\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.383690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383629    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-slash\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.383690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-env-overrides\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.383690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.383883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383755    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-run-ovn-kubernetes\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.383883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78l2\" (UniqueName: \"kubernetes.io/projected/a796d9c4-2021-4e97-94d9-f21634c7f151-kube-api-access-t78l2\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.383883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-var-lib-kubelet\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.383883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k524j\" (UniqueName: \"kubernetes.io/projected/962b4a42-1707-42a0-bdf5-412550b42192-kube-api-access-k524j\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysctl-conf\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-lib-modules\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vpgj\" (UniqueName: \"kubernetes.io/projected/991e1107-6aec-4eb1-bbca-cda61a517017-kube-api-access-7vpgj\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-cni-multus\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.383975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:48.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-cni-netd\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a796d9c4-2021-4e97-94d9-f21634c7f151-host-slash\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384140    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-sys-fs\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-system-cni-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-netns\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mft4p\" (UniqueName: \"kubernetes.io/projected/f1032707-923f-4532-b657-7048732e49ba-kube-api-access-mft4p\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384275    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/962b4a42-1707-42a0-bdf5-412550b42192-etc-tuned\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-socket-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384335    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-socket-dir-parent\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384346    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68d8fbe8-cab2-4389-a764-476d6b85683c-cni-binary-copy\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-multus-certs\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-etc-kubernetes\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-etc-kubernetes\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.384802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384533    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-sys-fs\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.384802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384763    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-system-cni-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.385048 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.384821    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-run-netns\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.385101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-socket-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.385338 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68d8fbe8-cab2-4389-a764-476d6b85683c-cni-binary-copy\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.385418 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385397    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc9274c0-a1f3-42c1-a941-68f36180a1db-agent-certs\") pod \"konnectivity-agent-cgxj9\" (UID: \"dc9274c0-a1f3-42c1-a941-68f36180a1db\") " pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.385496 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.385496 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-conf-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.385592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385516    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.385592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-kubelet\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.385730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-cnibin\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.385730 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.385632    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:48.385730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385665    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysconfig\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.385730 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.385714    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:09:48.885684648 +0000 UTC m=+2.979864833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:48.385929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-registration-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.385929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-conf-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.385929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-cni-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.385929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385867    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-registration-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.385929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-cnibin\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.385945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-kubelet\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-kubelet\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxw9b\" (UniqueName: \"kubernetes.io/projected/68d8fbe8-cab2-4389-a764-476d6b85683c-kube-api-access-sxw9b\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-var-lib-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.386155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-cni-dir\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/962b4a42-1707-42a0-bdf5-412550b42192-tmp\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.386441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386188    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.386441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/991e1107-6aec-4eb1-bbca-cda61a517017-tmp-dir\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.386441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc9274c0-a1f3-42c1-a941-68f36180a1db-konnectivity-ca\") pod \"konnectivity-agent-cgxj9\" (UID: \"dc9274c0-a1f3-42c1-a941-68f36180a1db\") " pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.386441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.386441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a796d9c4-2021-4e97-94d9-f21634c7f151-iptables-alerter-script\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.386441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-cnibin\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-systemd\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386526    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-sys\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386565    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386627    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-daemon-config\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386681    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/991e1107-6aec-4eb1-bbca-cda61a517017-tmp-dir\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386687    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.386746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386686    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lldtg"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-cni-bin\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-node-log\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovnkube-config\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxq7j\" (UniqueName: \"kubernetes.io/projected/40a30d08-2899-43f3-92c7-0b90844e6ba3-kube-api-access-kxq7j\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-host\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.386968    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-log-socket\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a9acddb-5d80-44e9-ae12-025daecdbc0e-dbus\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9hj\" (UniqueName: \"kubernetes.io/projected/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-kube-api-access-dd9hj\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-run-netns\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a9acddb-5d80-44e9-ae12-025daecdbc0e-dbus\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/68d8fbe8-cab2-4389-a764-476d6b85683c-multus-daemon-config\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387204    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/991e1107-6aec-4eb1-bbca-cda61a517017-hosts-file\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387323    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-device-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.387405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqvwp\" (UniqueName: \"kubernetes.io/projected/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-kube-api-access-rqvwp\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-cni-bin\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-etc-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovn-node-metrics-cert\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387523    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-systemd-units\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-systemd\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.387812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.387646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-ovn\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.388141 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.388013    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/991e1107-6aec-4eb1-bbca-cda61a517017-hosts-file\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.388141 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.388086    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-device-dir\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.388141 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.388128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68d8fbe8-cab2-4389-a764-476d6b85683c-host-var-lib-cni-bin\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.391432 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.391389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"cecf6a195bd7af1b2519a96aa95ed769","Type":"ContainerStarted","Data":"65dafd70947f84f41e075c25fc0b44be56f95038fc733c64d8ac0e2781fd8ff9"}
Sep 10 12:09:48.393282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.393254    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"03c4761a17877d2c4ef55ddef5cde326","Type":"ContainerStarted","Data":"33c5558efc7b485dcb924148bfe1430f9f5847816855cfc8a0947125eb091e1c"}
Sep 10 12:09:48.401298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.401269    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lldtg"
Sep 10 12:09:48.410765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.410735    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 12:09:48.412558 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.412531    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:09:48.412558 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.412552    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:09:48.412558 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.412563    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:48.412773 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.412616    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:09:48.912603661 +0000 UTC m=+3.006783849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:48.415646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.415623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxw9b\" (UniqueName: \"kubernetes.io/projected/68d8fbe8-cab2-4389-a764-476d6b85683c-kube-api-access-sxw9b\") pod \"multus-xp9tb\" (UID: \"68d8fbe8-cab2-4389-a764-476d6b85683c\") " pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.415744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.415627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vpgj\" (UniqueName: \"kubernetes.io/projected/991e1107-6aec-4eb1-bbca-cda61a517017-kube-api-access-7vpgj\") pod \"node-resolver-kjkm6\" (UID: \"991e1107-6aec-4eb1-bbca-cda61a517017\") " pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.417756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.417712    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqvwp\" (UniqueName: \"kubernetes.io/projected/7b49c69f-912c-42d9-9d0a-9bc85ae7464a-kube-api-access-rqvwp\") pod \"aws-ebs-csi-driver-node-w4tgf\" (UID: \"7b49c69f-912c-42d9-9d0a-9bc85ae7464a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.488364 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mft4p\" (UniqueName: \"kubernetes.io/projected/f1032707-923f-4532-b657-7048732e49ba-kube-api-access-mft4p\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.488499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488373    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/962b4a42-1707-42a0-bdf5-412550b42192-etc-tuned\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.488499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488399    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc9274c0-a1f3-42c1-a941-68f36180a1db-agent-certs\") pod \"konnectivity-agent-cgxj9\" (UID: \"dc9274c0-a1f3-42c1-a941-68f36180a1db\") " pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.488499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.488499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-kubelet\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.488499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-cnibin\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysconfig\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-var-lib-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/962b4a42-1707-42a0-bdf5-412550b42192-tmp\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc9274c0-a1f3-42c1-a941-68f36180a1db-konnectivity-ca\") pod \"konnectivity-agent-cgxj9\" (UID: \"dc9274c0-a1f3-42c1-a941-68f36180a1db\") " pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-cnibin\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488702    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a796d9c4-2021-4e97-94d9-f21634c7f151-iptables-alerter-script\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.488727    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:48.488770 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.488766    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:48.988754036 +0000 UTC m=+3.082934208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-systemd\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-systemd\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488822    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-kubelet\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-sys\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488864    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysconfig\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-cni-bin\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-sys\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-node-log\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488924    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-var-lib-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovnkube-config\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488982    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-node-log\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxq7j\" (UniqueName: \"kubernetes.io/projected/40a30d08-2899-43f3-92c7-0b90844e6ba3-kube-api-access-kxq7j\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.488959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-cni-bin\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-host\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489041    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-log-socket\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9hj\" (UniqueName: \"kubernetes.io/projected/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-kube-api-access-dd9hj\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.489271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489093    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-run-netns\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489159    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-etc-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489167    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-log-socket\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovn-node-metrics-cert\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489210    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489219    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-host\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-systemd-units\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-systemd\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-ovn\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6aa15bd8-8bd6-4d32-95d3-c2a933917512-host\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489362    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6aa15bd8-8bd6-4d32-95d3-c2a933917512-serviceca\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovnkube-script-lib\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-system-cni-dir\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489441    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-modprobe-d\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-kubernetes\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.490223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysctl-d\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-run\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovnkube-config\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489631    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqdfb\" (UniqueName: \"kubernetes.io/projected/6aa15bd8-8bd6-4d32-95d3-c2a933917512-kube-api-access-sqdfb\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-slash\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-env-overrides\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489735    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-run-ovn-kubernetes\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78l2\" (UniqueName: \"kubernetes.io/projected/a796d9c4-2021-4e97-94d9-f21634c7f151-kube-api-access-t78l2\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-var-lib-kubelet\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k524j\" (UniqueName: \"kubernetes.io/projected/962b4a42-1707-42a0-bdf5-412550b42192-kube-api-access-k524j\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489822    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489832    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-run-netns\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysctl-conf\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489870    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-lib-modules\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489886    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-etc-openvswitch\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.491118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-cni-netd\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489940    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a796d9c4-2021-4e97-94d9-f21634c7f151-host-slash\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489961    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysctl-d\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a796d9c4-2021-4e97-94d9-f21634c7f151-host-slash\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-systemd-units\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490022    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a796d9c4-2021-4e97-94d9-f21634c7f151-iptables-alerter-script\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.489478    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc9274c0-a1f3-42c1-a941-68f36180a1db-konnectivity-ca\") pod \"konnectivity-agent-cgxj9\" (UID: \"dc9274c0-a1f3-42c1-a941-68f36180a1db\") " pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-systemd\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-cni-netd\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-sysctl-conf\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-run-ovn\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6aa15bd8-8bd6-4d32-95d3-c2a933917512-host\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490416    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-run\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490443    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-var-lib-kubelet\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490467    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490537    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-slash\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490588    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1032707-923f-4532-b657-7048732e49ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490705    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6aa15bd8-8bd6-4d32-95d3-c2a933917512-serviceca\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490809    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-modprobe-d\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490869    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-etc-kubernetes\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a30d08-2899-43f3-92c7-0b90844e6ba3-host-run-ovn-kubernetes\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490910    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-env-overrides\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.490923    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1032707-923f-4532-b657-7048732e49ba-system-cni-dir\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.491017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/962b4a42-1707-42a0-bdf5-412550b42192-lib-modules\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.491134    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovnkube-script-lib\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.492984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.492588    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40a30d08-2899-43f3-92c7-0b90844e6ba3-ovn-node-metrics-cert\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.493338 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.493049    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/962b4a42-1707-42a0-bdf5-412550b42192-etc-tuned\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.494106 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.494021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/962b4a42-1707-42a0-bdf5-412550b42192-tmp\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.494503 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.494185    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc9274c0-a1f3-42c1-a941-68f36180a1db-agent-certs\") pod \"konnectivity-agent-cgxj9\" (UID: \"dc9274c0-a1f3-42c1-a941-68f36180a1db\") " pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.502492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.502447    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxq7j\" (UniqueName: \"kubernetes.io/projected/40a30d08-2899-43f3-92c7-0b90844e6ba3-kube-api-access-kxq7j\") pod \"ovnkube-node-59wst\" (UID: \"40a30d08-2899-43f3-92c7-0b90844e6ba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.513290 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.512659    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k524j\" (UniqueName: \"kubernetes.io/projected/962b4a42-1707-42a0-bdf5-412550b42192-kube-api-access-k524j\") pod \"tuned-wl2hp\" (UID: \"962b4a42-1707-42a0-bdf5-412550b42192\") " pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.513290 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.513125    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9hj\" (UniqueName: \"kubernetes.io/projected/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-kube-api-access-dd9hj\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.513955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.513914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mft4p\" (UniqueName: \"kubernetes.io/projected/f1032707-923f-4532-b657-7048732e49ba-kube-api-access-mft4p\") pod \"multus-additional-cni-plugins-dmw2b\" (UID: \"f1032707-923f-4532-b657-7048732e49ba\") " pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.514777 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.514678    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqdfb\" (UniqueName: \"kubernetes.io/projected/6aa15bd8-8bd6-4d32-95d3-c2a933917512-kube-api-access-sqdfb\") pod \"node-ca-wtncr\" (UID: \"6aa15bd8-8bd6-4d32-95d3-c2a933917512\") " pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.515724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.515682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78l2\" (UniqueName: \"kubernetes.io/projected/a796d9c4-2021-4e97-94d9-f21634c7f151-kube-api-access-t78l2\") pod \"iptables-alerter-lmf29\" (UID: \"a796d9c4-2021-4e97-94d9-f21634c7f151\") " pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.582353 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.582331    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xp9tb"
Sep 10 12:09:48.591635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.591617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kjkm6"
Sep 10 12:09:48.602596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.602575    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf"
Sep 10 12:09:48.610166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.610020    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtncr"
Sep 10 12:09:48.618901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.618878    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:09:48.627535 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.627515    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dmw2b"
Sep 10 12:09:48.635690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.635674    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:09:48.645529 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.645503    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lmf29"
Sep 10 12:09:48.652282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.652265    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl2hp"
Sep 10 12:09:48.736617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.736593    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 12:09:48.892952 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.892858    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:48.893091 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.893008    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:48.893091 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.893075    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:09:49.893053909 +0000 UTC m=+3.987234098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:48.993980 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.993945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:48.994171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:48.994004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:48.994171 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.994125    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:48.994352 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.994188    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:49.994168836 +0000 UTC m=+4.088349013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:48.994352 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.994128    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:09:48.994352 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.994267    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:09:48.994352 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.994288    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:48.994352 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:48.994347    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:09:49.994329247 +0000 UTC m=+4.088509441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:49.383656 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:49.383577    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:49.384123 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:49.383717    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:09:49.405989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:49.405941    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:04:49 +0000 UTC" deadline="2028-04-14 06:39:52.40478026 +0000 UTC"
Sep 10 12:09:49.405989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:49.405981    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13962h30m2.998804099s"
Sep 10 12:09:49.707785 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.707741    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a30d08_2899_43f3_92c7_0b90844e6ba3.slice/crio-05d773f515c56f9bc6fa05aaa648cf4fca818b92fc8eea7ee908fa052cfaea13 WatchSource:0}: Error finding container 05d773f515c56f9bc6fa05aaa648cf4fca818b92fc8eea7ee908fa052cfaea13: Status 404 returned error can't find the container with id 05d773f515c56f9bc6fa05aaa648cf4fca818b92fc8eea7ee908fa052cfaea13
Sep 10 12:09:49.709773 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.708928    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991e1107_6aec_4eb1_bbca_cda61a517017.slice/crio-ee0e2175cf5228dfc0906577acccb1acb62045df4e059704462d14252046616b WatchSource:0}: Error finding container ee0e2175cf5228dfc0906577acccb1acb62045df4e059704462d14252046616b: Status 404 returned error can't find the container with id ee0e2175cf5228dfc0906577acccb1acb62045df4e059704462d14252046616b
Sep 10 12:09:49.710952 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.710409    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1032707_923f_4532_b657_7048732e49ba.slice/crio-88065fcd44df6a9336159e530baa77982489a4e7b14094265a53b06611d1be12 WatchSource:0}: Error finding container 88065fcd44df6a9336159e530baa77982489a4e7b14094265a53b06611d1be12: Status 404 returned error can't find the container with id 88065fcd44df6a9336159e530baa77982489a4e7b14094265a53b06611d1be12
Sep 10 12:09:49.712804 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.712677    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9274c0_a1f3_42c1_a941_68f36180a1db.slice/crio-bf565e6b03e1189e53a4bfb384d4f70b7724936a6eda5aaf5bf03146300cc3f9 WatchSource:0}: Error finding container bf565e6b03e1189e53a4bfb384d4f70b7724936a6eda5aaf5bf03146300cc3f9: Status 404 returned error can't find the container with id bf565e6b03e1189e53a4bfb384d4f70b7724936a6eda5aaf5bf03146300cc3f9
Sep 10 12:09:49.716019 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.715992    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d8fbe8_cab2_4389_a764_476d6b85683c.slice/crio-d5c2c0d64d16c0631a5532a16ae1f9f91b51af5df286221b4ff23233edd045e8 WatchSource:0}: Error finding container d5c2c0d64d16c0631a5532a16ae1f9f91b51af5df286221b4ff23233edd045e8: Status 404 returned error can't find the container with id d5c2c0d64d16c0631a5532a16ae1f9f91b51af5df286221b4ff23233edd045e8
Sep 10 12:09:49.716975 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.716740    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda796d9c4_2021_4e97_94d9_f21634c7f151.slice/crio-4582b83cc6d5876f001c37bb05866462aea184f430b677f50f8400abd5383a1b WatchSource:0}: Error finding container 4582b83cc6d5876f001c37bb05866462aea184f430b677f50f8400abd5383a1b: Status 404 returned error can't find the container with id 4582b83cc6d5876f001c37bb05866462aea184f430b677f50f8400abd5383a1b
Sep 10 12:09:49.718390 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.718040    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b49c69f_912c_42d9_9d0a_9bc85ae7464a.slice/crio-b8acb4ea55d02f1d70c6620c0d12a1597c2f5f39cf1e5febbf26677589003a6f WatchSource:0}: Error finding container b8acb4ea55d02f1d70c6620c0d12a1597c2f5f39cf1e5febbf26677589003a6f: Status 404 returned error can't find the container with id b8acb4ea55d02f1d70c6620c0d12a1597c2f5f39cf1e5febbf26677589003a6f
Sep 10 12:09:49.720098 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.719637    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa15bd8_8bd6_4d32_95d3_c2a933917512.slice/crio-d4db66a4425f07b118e4bea2af6b21b058c8482469e57e8dcfe6933fc676e75c WatchSource:0}: Error finding container d4db66a4425f07b118e4bea2af6b21b058c8482469e57e8dcfe6933fc676e75c: Status 404 returned error can't find the container with id d4db66a4425f07b118e4bea2af6b21b058c8482469e57e8dcfe6933fc676e75c
Sep 10 12:09:49.720935 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:09:49.720453    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962b4a42_1707_42a0_bdf5_412550b42192.slice/crio-516f65ad9782919aeaa2e04e04de506dfc6e6c3f8bc0cad713d28c666a54dedb WatchSource:0}: Error finding container 516f65ad9782919aeaa2e04e04de506dfc6e6c3f8bc0cad713d28c666a54dedb: Status 404 returned error can't find the container with id 516f65ad9782919aeaa2e04e04de506dfc6e6c3f8bc0cad713d28c666a54dedb
Sep 10 12:09:49.902992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:49.902957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:49.903128 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:49.903110    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:49.903225 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:49.903194    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:09:51.903169656 +0000 UTC m=+5.997349850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:50.003661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.003626    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:50.003790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.003720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:50.003835 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.003783    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:50.003835 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.003820    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:09:50.003835 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.003835    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:09:50.003943 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.003849    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:50.003943 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.003853    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:52.003832526 +0000 UTC m=+6.098012714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:50.003943 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.003885    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:09:52.003874339 +0000 UTC m=+6.098054511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:50.384424 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.384282    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:50.385243 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.384440    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:09:50.385243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.384574    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:50.385243 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:50.384682    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:09:50.398866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.398810    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xp9tb" event={"ID":"68d8fbe8-cab2-4389-a764-476d6b85683c","Type":"ContainerStarted","Data":"d5c2c0d64d16c0631a5532a16ae1f9f91b51af5df286221b4ff23233edd045e8"}
Sep 10 12:09:50.400004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.399944    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kjkm6" event={"ID":"991e1107-6aec-4eb1-bbca-cda61a517017","Type":"ContainerStarted","Data":"ee0e2175cf5228dfc0906577acccb1acb62045df4e059704462d14252046616b"}
Sep 10 12:09:50.405323 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.405292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"05d773f515c56f9bc6fa05aaa648cf4fca818b92fc8eea7ee908fa052cfaea13"}
Sep 10 12:09:50.406273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.406223    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:04:49 +0000 UTC" deadline="2028-02-22 12:42:26.116129086 +0000 UTC"
Sep 10 12:09:50.406273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.406250    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12720h32m35.709883427s"
Sep 10 12:09:50.407747 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.407638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf" event={"ID":"7b49c69f-912c-42d9-9d0a-9bc85ae7464a","Type":"ContainerStarted","Data":"b8acb4ea55d02f1d70c6620c0d12a1597c2f5f39cf1e5febbf26677589003a6f"}
Sep 10 12:09:50.409593 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.409536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmf29" event={"ID":"a796d9c4-2021-4e97-94d9-f21634c7f151","Type":"ContainerStarted","Data":"4582b83cc6d5876f001c37bb05866462aea184f430b677f50f8400abd5383a1b"}
Sep 10 12:09:50.413481 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.413384    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cgxj9" event={"ID":"dc9274c0-a1f3-42c1-a941-68f36180a1db","Type":"ContainerStarted","Data":"bf565e6b03e1189e53a4bfb384d4f70b7724936a6eda5aaf5bf03146300cc3f9"}
Sep 10 12:09:50.415023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.414934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerStarted","Data":"88065fcd44df6a9336159e530baa77982489a4e7b14094265a53b06611d1be12"}
Sep 10 12:09:50.419006 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.418289    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"cecf6a195bd7af1b2519a96aa95ed769","Type":"ContainerStarted","Data":"5e688f0cdc1e077eec11aec93cb92c786699ff895b1476628c10c5b3ede0bf2e"}
Sep 10 12:09:50.421592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.420995    2557 generic.go:356] "Generic (PLEG): container finished" podID="03c4761a17877d2c4ef55ddef5cde326" containerID="498340474d7d54a10d2b310d2bc234cd2ee17d2c3fb53d82b8615388b45a0cb1" exitCode=0
Sep 10 12:09:50.421592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.421075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"03c4761a17877d2c4ef55ddef5cde326","Type":"ContainerDied","Data":"498340474d7d54a10d2b310d2bc234cd2ee17d2c3fb53d82b8615388b45a0cb1"}
Sep 10 12:09:50.429446 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.429365    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl2hp" event={"ID":"962b4a42-1707-42a0-bdf5-412550b42192","Type":"ContainerStarted","Data":"516f65ad9782919aeaa2e04e04de506dfc6e6c3f8bc0cad713d28c666a54dedb"}
Sep 10 12:09:50.431102 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.431076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtncr" event={"ID":"6aa15bd8-8bd6-4d32-95d3-c2a933917512","Type":"ContainerStarted","Data":"d4db66a4425f07b118e4bea2af6b21b058c8482469e57e8dcfe6933fc676e75c"}
Sep 10 12:09:50.468801 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:50.468211    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" podStartSLOduration=2.468191729 podStartE2EDuration="2.468191729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:50.441872711 +0000 UTC m=+4.536052907" watchObservedRunningTime="2026-09-10 12:09:50.468191729 +0000 UTC m=+4.562371926"
Sep 10 12:09:51.384435 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:51.383904    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:51.384435 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:51.384035    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:09:51.463597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:51.463562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"03c4761a17877d2c4ef55ddef5cde326","Type":"ContainerStarted","Data":"5fdedf7b74256db526d4858339ed10b00c8d6c2a48d1604daed70c7c1e7fbeb6"}
Sep 10 12:09:51.919573 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:51.919506    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:51.919753 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:51.919681    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:51.919753 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:51.919744    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:09:55.919724579 +0000 UTC m=+10.013904774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:52.020889 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:52.020853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:52.021100 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:52.020967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:52.021179 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.021123    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:09:52.021179 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.021148    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:09:52.021179 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.021162    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:52.021384 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.021218    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:09:56.021197854 +0000 UTC m=+10.115378029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:52.021659 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.021638    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:52.021745 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.021709    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:56.021690699 +0000 UTC m=+10.115870873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:52.387621 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:52.386730    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:52.387621 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.386862    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:09:52.387621 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:52.387273    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:52.387621 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:52.387375    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:09:53.384270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:53.384230    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:53.384491 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:53.384422    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:09:54.384605 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:54.384561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:54.385104 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:54.384705    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:09:54.385104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:54.384961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:54.385104 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:54.385075    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:09:55.383704 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:55.383612    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:55.383870 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:55.383773    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:09:55.953234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:55.953195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:55.953743 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:55.953331    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:55.953743 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:55.953382    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:10:03.953365737 +0000 UTC m=+18.047545909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:09:56.054104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:56.053996    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:56.054104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:56.054049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:56.054359 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.054155    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:09:56.054359 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.054183    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:09:56.054359 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.054189    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:56.054359 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.054268    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:04.054246974 +0000 UTC m=+18.148427161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:09:56.054681 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.054199    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:56.054681 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.054651    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:10:04.054633293 +0000 UTC m=+18.148813488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:09:56.385144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:56.385064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:56.385305 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:56.385153    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:56.385305 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.385171    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:09:56.385305 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:56.385289    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:09:57.384222 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:57.384191    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:57.384766 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:57.384373    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:09:58.384133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:58.384047    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:09:58.384283 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:58.384175    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:09:58.385609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:58.385587    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:09:58.385720 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:58.385700    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:09:59.383835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:09:59.383800    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:09:59.383996 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:09:59.383934    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:00.383922 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:00.383886    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:00.384379 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:00.384018    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:00.384379 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:00.384059    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:00.384379 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:00.384145    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:01.384360 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:01.384320    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:01.384822 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:01.384455    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:02.384084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:02.384048    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:02.384265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:02.384047    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:02.384265 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:02.384191    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:02.384265 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:02.384254    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:03.383629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:03.383601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:03.383878 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:03.383710    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:04.015748 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:04.015716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:04.016087 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.015862    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:10:04.016087 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.015919    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:10:20.015906069 +0000 UTC m=+34.110086243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:10:04.116395 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:04.116367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:04.116539 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:04.116408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:04.116539 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.116527    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:10:04.116604 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.116542    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:10:04.116604 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.116559    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:10:04.116604 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.116571    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:10:04.116604 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.116586    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:20.116569882 +0000 UTC m=+34.210750063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:10:04.116720 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.116607    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:10:20.116595915 +0000 UTC m=+34.210776089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:10:04.383555 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:04.383476    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:04.383692 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.383604    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:04.383692 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:04.383659    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:04.383800 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:04.383778    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:05.383645 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:05.383609    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:05.384055 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:05.383717    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:06.384741 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:06.384702    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:06.385179 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:06.384817    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:06.385179 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:06.384871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:06.385179 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:06.384969    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:07.383570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:07.383541    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:07.383749 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:07.383663    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:08.384495 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.384244    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:08.385264 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.384305    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:08.385264 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:08.384619    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:08.385264 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:08.384643    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:08.501928 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.501896    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl2hp" event={"ID":"962b4a42-1707-42a0-bdf5-412550b42192","Type":"ContainerStarted","Data":"1c120e7eb0c1c8e904e7cfcedca7a03cc2346fbc74bdedc0a829018edd60db80"}
Sep 10 12:10:08.503450 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.503411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtncr" event={"ID":"6aa15bd8-8bd6-4d32-95d3-c2a933917512","Type":"ContainerStarted","Data":"a3d8c6d7ad2e4f6af86f829513a5a0eddd390fae3c986e060ce82bef09a1ca0d"}
Sep 10 12:10:08.504931 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.504912    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xp9tb" event={"ID":"68d8fbe8-cab2-4389-a764-476d6b85683c","Type":"ContainerStarted","Data":"c5f400a267695be53e2f61ca34c83007e37bb4fe516cdd0d8dd1964bae0da236"}
Sep 10 12:10:08.506390 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.506358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kjkm6" event={"ID":"991e1107-6aec-4eb1-bbca-cda61a517017","Type":"ContainerStarted","Data":"bf8a76833e61ab69831027ce03f27f3ca6d32c8be8b280ada6faf94c6ff69677"}
Sep 10 12:10:08.509382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.509363    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"200afa1f1d138c10f2917049a1941bdf271654f600081469eadc11a76519b4b3"}
Sep 10 12:10:08.509512 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.509496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"949f6a44d7c9976ddcc15f794ce75657d99faa03a5069fd91bb0ca99a83ee62d"}
Sep 10 12:10:08.509582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.509562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"77ddb7bd57090b2535f7cae0320960825bbc1335683ee6c140eb8d45f22638eb"}
Sep 10 12:10:08.509639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.509612    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"313e79520dae70766c15ae48373d2dc9cc7c4b84026e90c928a50c357142faa9"}
Sep 10 12:10:08.509692 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.509661    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"69072e3f26a1a8f12d9e6c28f100bdcdf59ac41e66a9d902728808e31b91c99c"}
Sep 10 12:10:08.509744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.509711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"60454f234ede199c180fcedb12384fa81dac92abcc7a912ed8c4dee220cf0c38"}
Sep 10 12:10:08.510850 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.510828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf" event={"ID":"7b49c69f-912c-42d9-9d0a-9bc85ae7464a","Type":"ContainerStarted","Data":"80cf402e2feff5889bfc73ffddfdd2dd7b5fb8554ceecb457aab57028dc887bb"}
Sep 10 12:10:08.512252 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.512230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cgxj9" event={"ID":"dc9274c0-a1f3-42c1-a941-68f36180a1db","Type":"ContainerStarted","Data":"a0648023992caa07a97fcdfd793ec1c2884fbe8ef78017d7e97fdbbc402c6fc7"}
Sep 10 12:10:08.513733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.513713    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1032707-923f-4532-b657-7048732e49ba" containerID="f5a49acfcca99990eae591281f485a577aee643437c1e6c4c8192c0504da925d" exitCode=0
Sep 10 12:10:08.513808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.513739    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerDied","Data":"f5a49acfcca99990eae591281f485a577aee643437c1e6c4c8192c0504da925d"}
Sep 10 12:10:08.541500 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.541461    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" podStartSLOduration=20.541450774 podStartE2EDuration="20.541450774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:51.492252748 +0000 UTC m=+5.586432945" watchObservedRunningTime="2026-09-10 12:10:08.541450774 +0000 UTC m=+22.635630965"
Sep 10 12:10:08.565963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.565922    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wl2hp" podStartSLOduration=3.34075331 podStartE2EDuration="21.56590996s" totalImagesPullingTime="18.22515665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.5419178 +0000 UTC m=+22.636098002" watchObservedRunningTime="2026-09-10 12:10:08.56590996 +0000 UTC m=+22.660090152"
Sep 10 12:10:08.602111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.600723    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wtncr" podStartSLOduration=3.428053712 podStartE2EDuration="21.60070605s" totalImagesPullingTime="18.172652338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.565796396 +0000 UTC m=+22.659976588" watchObservedRunningTime="2026-09-10 12:10:08.60070605 +0000 UTC m=+22.694886242"
Sep 10 12:10:08.668658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.668598    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cgxj9" podStartSLOduration=10.831141746 podStartE2EDuration="21.668586651s" totalImagesPullingTime="10.837444905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.635987692 +0000 UTC m=+22.730167885" watchObservedRunningTime="2026-09-10 12:10:08.668586651 +0000 UTC m=+22.762766834"
Sep 10 12:10:08.668986 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.668966    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xp9tb" podStartSLOduration=3.432526626 podStartE2EDuration="21.668961828s" totalImagesPullingTime="18.236435202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.667257196 +0000 UTC m=+22.761437389" watchObservedRunningTime="2026-09-10 12:10:08.668961828 +0000 UTC m=+22.763142039"
Sep 10 12:10:08.694912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.694878    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kjkm6" podStartSLOduration=3.505789422 podStartE2EDuration="21.694867762s" totalImagesPullingTime="18.18907834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.69260475 +0000 UTC m=+22.786784942" watchObservedRunningTime="2026-09-10 12:10:08.694867762 +0000 UTC m=+22.789047954"
Sep 10 12:10:08.888385 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:08.888364    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:09.005830 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.005804    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:09.383693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.383540    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:09.383693 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:09.383657    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:09.387368 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.387337    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 12:10:09.517673 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.517608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lmf29" event={"ID":"a796d9c4-2021-4e97-94d9-f21634c7f151","Type":"ContainerStarted","Data":"034c3ca4e606e132cd8addc69a7a66ffc161f3240116594e56c6269fc18e60b7"}
Sep 10 12:10:09.520005 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.519974    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf" event={"ID":"7b49c69f-912c-42d9-9d0a-9bc85ae7464a","Type":"ContainerStarted","Data":"7bd7d33ac22f2375945f3a4815c9ffc12de3932b1e3de073399cc8d94b6ca8a6"}
Sep 10 12:10:09.537084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.537047    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lmf29" podStartSLOduration=4.352791526 podStartE2EDuration="22.537027948s" totalImagesPullingTime="18.184236422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:09.537008554 +0000 UTC m=+23.631188737" watchObservedRunningTime="2026-09-10 12:10:09.537027948 +0000 UTC m=+23.631208140"
Sep 10 12:10:09.686878 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.686814    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:09.785515 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:09.785474    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:10.349718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.349600    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:10:09.38737656Z","UUID":"82c12e1d-f4f2-4362-a30b-dedbaffa34cf","Handler":null,"Name":"","Endpoint":""}
Sep 10 12:10:10.350987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.350970    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 12:10:10.351086 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.350996    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 12:10:10.383866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.383834    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:10.383995 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:10.383960    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:10.384062 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.384017    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:10.384161 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:10.384131    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:10.524666 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.524630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf" event={"ID":"7b49c69f-912c-42d9-9d0a-9bc85ae7464a","Type":"ContainerStarted","Data":"90ee4fb52919e15ce4672bfed21dc84d3af609faa78e1ec8543d2b10fa3bc048"}
Sep 10 12:10:10.877058 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.876974    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:10.979909 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:10.979876    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:11.384439 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:11.384401    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:11.384604 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:11.384513    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:11.531035 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:11.530997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"6a54c2aca9c60bab87789013f8a1c8de7b0dfaa6fa209ca38856f9ee6bc3a957"}
Sep 10 12:10:11.541697 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:11.541667    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:11.625893 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:11.625865    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:12.298671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.297942    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:10:12.298671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.298542    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:10:12.317978 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.317928    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tgf" podStartSLOduration=5.133034717 podStartE2EDuration="25.317914556s" totalImagesPullingTime="20.184879839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:10.557656802 +0000 UTC m=+24.651837006" watchObservedRunningTime="2026-09-10 12:10:12.317914556 +0000 UTC m=+26.412094757"
Sep 10 12:10:12.383669 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.383644    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:12.383824 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:12.383750    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:12.383824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.383808    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:12.383971 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:12.383923    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:12.533058 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.533028    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:10:12.533662 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.533638    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cgxj9"
Sep 10 12:10:12.615971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.615926    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:12.745019 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:12.744987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:13.383934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:13.383904    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:13.384086 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:13.384019    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:13.466169 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:13.466143    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:14.384192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.384159    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:14.384900 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:14.384283    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:14.384900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.384342    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:14.384900 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:14.384482    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:14.540464 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.540421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" event={"ID":"40a30d08-2899-43f3-92c7-0b90844e6ba3","Type":"ContainerStarted","Data":"d04223f72c585d7165845eda789be5e75defd78487447f5a8f8bf61e8e12913d"}
Sep 10 12:10:14.540783 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.540755    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:10:14.542297 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.542276    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1032707-923f-4532-b657-7048732e49ba" containerID="5178ac410ff773080f2cccb90d8da0cbf13d0a87d6130b2ec640c67006204981" exitCode=0
Sep 10 12:10:14.542395 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.542367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerDied","Data":"5178ac410ff773080f2cccb90d8da0cbf13d0a87d6130b2ec640c67006204981"}
Sep 10 12:10:14.556025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.556006    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:10:14.604925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:14.604883    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-59wst" podStartSLOduration=9.35607171 podStartE2EDuration="27.604870131s" totalImagesPullingTime="18.248798421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:14.574230259 +0000 UTC m=+28.668410451" watchObservedRunningTime="2026-09-10 12:10:14.604870131 +0000 UTC m=+28.699050315"
Sep 10 12:10:15.146414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.146284    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:15.262367 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.262296    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:15.363312 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.363284    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:15.384307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.384280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:15.384669 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:15.384397    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:15.473207 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.473183    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:15.546881 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.546816    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1032707-923f-4532-b657-7048732e49ba" containerID="68682775b0d054bbed42f5f0687815cca12227093a8d133daf2256c22e9d89e2" exitCode=0
Sep 10 12:10:15.547016 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.546902    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerDied","Data":"68682775b0d054bbed42f5f0687815cca12227093a8d133daf2256c22e9d89e2"}
Sep 10 12:10:15.547347 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.547332    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:10:15.547448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.547394    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:10:15.562014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.561993    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:10:15.579968 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.579946    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:15.835713 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.835632    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4mcmv"]
Sep 10 12:10:15.835863 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.835799    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:15.835936 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:15.835913    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:15.843116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.843078    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xn6sq"]
Sep 10 12:10:15.843231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.843195    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:15.843302 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:15.843281    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:15.843667 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.843646    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cgl6b"]
Sep 10 12:10:15.843775 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:15.843724    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:15.843829 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:15.843790    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:16.245618 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:16.245574    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:16.344105 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:16.344074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:16.636015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:16.635985    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kjkm6_991e1107-6aec-4eb1-bbca-cda61a517017/dns-node-resolver/0.log"
Sep 10 12:10:16.923510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:16.923441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:17.226692 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.226603    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:17.384387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.384359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:17.384562 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.384405    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:17.384562 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.384490    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:17.384562 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:17.384511    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:17.384719 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:17.384603    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:17.384719 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:17.384686    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:17.556359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.556334    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1032707-923f-4532-b657-7048732e49ba" containerID="cda22acfa7fb1246547d9392e9d3e01d92091e1681b717ee6e67e96d3c4d4e2a" exitCode=0
Sep 10 12:10:17.556487 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.556437    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerDied","Data":"cda22acfa7fb1246547d9392e9d3e01d92091e1681b717ee6e67e96d3c4d4e2a"}
Sep 10 12:10:17.560065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.560041    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:17.836597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:17.836527    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtncr_6aa15bd8-8bd6-4d32-95d3-c2a933917512/node-ca/0.log"
Sep 10 12:10:18.655391 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:18.655361    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:18.764868 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:18.764833    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:19.384188 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:19.384164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:19.384651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:19.384164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:19.384651 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:19.384278    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:19.384651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:19.384164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:19.384651 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:19.384354    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:19.384651 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:19.384413    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:19.867810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:19.867780    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:19.969582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:19.969542    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:20.029456 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.029413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:20.029584 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.029563    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 12:10:20.029648 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.029627    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret podName:8a9acddb-5d80-44e9-ae12-025daecdbc0e nodeName:}" failed. No retries permitted until 2026-09-10 12:10:52.029611429 +0000 UTC m=+66.123791609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret") pod "global-pull-secret-syncer-xn6sq" (UID: "8a9acddb-5d80-44e9-ae12-025daecdbc0e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 12:10:20.130304 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.130233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:20.130304 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.130278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:20.130483 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.130395    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:10:20.130483 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.130421    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 12:10:20.130483 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.130457    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 12:10:20.130483 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.130470    2557 projected.go:196] Error preparing data for projected volume kube-api-access-zmxkq for pod openshift-network-diagnostics/network-check-target-cgl6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:10:20.130636 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.130459    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs podName:546b25de-6cb1-4c8c-afbf-74ee5dce1d53 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:52.130441054 +0000 UTC m=+66.224621229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs") pod "network-metrics-daemon-4mcmv" (UID: "546b25de-6cb1-4c8c-afbf-74ee5dce1d53") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 12:10:20.130636 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:20.130534    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq podName:0ef9844d-c3f5-455c-9981-bc39b349ec3c nodeName:}" failed. No retries permitted until 2026-09-10 12:10:52.130518456 +0000 UTC m=+66.224698637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmxkq" (UniqueName: "kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq") pod "network-check-target-cgl6b" (UID: "0ef9844d-c3f5-455c-9981-bc39b349ec3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 12:10:20.170064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.170031    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:20.568232 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.568149    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:20.828485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.828399    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:20.938837 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:20.938801    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:21.049465 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.049395    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:21.201816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.201739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:21.364961 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.364923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:21.383640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.383615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:21.383762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.383647    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:21.383762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.383615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:21.383762 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:21.383729    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:21.383901 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:21.383801    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:21.383901 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:21.383875    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:21.719018 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:21.718974    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:22.099028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:22.098938    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:22.277202 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:22.277172    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:22.571131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:22.571099    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerStarted","Data":"2a7cdcd1e4ff6909a0dd4683f768099b147ab0706c09cd7c7e286e261ab9546f"}
Sep 10 12:10:22.850997 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:22.850913    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:23.383447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.383400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:23.383614 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.383400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:23.383614 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:23.383509    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:23.383731 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:23.383613    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:23.383731 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.383400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:23.383731 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:23.383708    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:23.575512 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.575482    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1032707-923f-4532-b657-7048732e49ba" containerID="2a7cdcd1e4ff6909a0dd4683f768099b147ab0706c09cd7c7e286e261ab9546f" exitCode=0
Sep 10 12:10:23.575648 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.575523    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerDied","Data":"2a7cdcd1e4ff6909a0dd4683f768099b147ab0706c09cd7c7e286e261ab9546f"}
Sep 10 12:10:23.582870 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.582851    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:23.667012 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:23.666985    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:24.279196 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:24.279160    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:24.378043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:24.378017    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:24.469872 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:24.469847    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:24.580566 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:24.580510    2557 generic.go:356] "Generic (PLEG): container finished" podID="f1032707-923f-4532-b657-7048732e49ba" containerID="1caa5edc57717128bdcbb54dcb51d156c19d6cfb9f85e60de0506b3c2754d8fb" exitCode=0
Sep 10 12:10:24.580566 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:24.580564    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerDied","Data":"1caa5edc57717128bdcbb54dcb51d156c19d6cfb9f85e60de0506b3c2754d8fb"}
Sep 10 12:10:24.644884 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:24.644856    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:25.033482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.033451    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:25.100565 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.100539    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:25.383858 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.383831    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:25.384271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.383923    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:25.384271 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:25.383929    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:25.384271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.383949    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:25.384271 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:25.384010    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:25.384271 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:25.384073    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:25.586092 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.586067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" event={"ID":"f1032707-923f-4532-b657-7048732e49ba","Type":"ContainerStarted","Data":"dc4918efd4e3f5cede1e4fc31044ec5234ce44fe66c021fe077a86eac6bce45f"}
Sep 10 12:10:25.617910 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.617842    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dmw2b" podStartSLOduration=7.365007167 podStartE2EDuration="38.61782935s" totalImagesPullingTime="31.252822183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:25.617674479 +0000 UTC m=+39.711854671" watchObservedRunningTime="2026-09-10 12:10:25.61782935 +0000 UTC m=+39.712009538"
Sep 10 12:10:25.854334 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:25.854305    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:26.370856 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:26.370827    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:26.467223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:26.467192    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:26.855802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:26.855720    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:26.974173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:26.974141    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:27.383790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:27.383760    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:27.383929 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:27.383847    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:27.383929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:27.383765    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:27.384011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:27.383870    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:27.384011 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:27.383943    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:27.384081 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:27.384038    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:27.479924 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:27.479898    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:27.584511 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:27.584489    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:27.684028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:27.683973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:28.056203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:28.056135    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:28.257494 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:28.257452    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:28.455493 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:28.455470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:28.567238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:28.567217    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:28.645239 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:28.645218    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:28.802088 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:28.802034    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:29.039102 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:29.039074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:29.245353 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:29.245330    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:29.383902 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:29.383880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:29.384008 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:29.383962    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:29.384008 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:29.383969    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:29.384091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:29.384040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:29.384132 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:29.384102    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:29.384132 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:29.384038    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:29.836384 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:29.836356    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:30.549617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:30.549585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:30.687593 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:30.687558    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:31.047032 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:31.047003    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:31.383769 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:31.383747    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:31.383769 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:31.383762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:31.383944 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:31.383747    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:31.383944 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:31.383830    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:31.383944 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:31.383907    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:31.384059 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:31.383968    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:31.891799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:31.891772    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:31.992868 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:31.992839    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:33.383416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:33.383389    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:33.383416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:33.383407    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:33.383802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:33.383389    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:33.383802 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:33.383490    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:33.383802 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:33.383565    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:33.383802 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:33.383617    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:34.860538 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:34.860503    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:34.923132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:34.923104    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:35.383731 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:35.383703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:35.383876 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:35.383703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:35.383876 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:35.383798    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:35.383876 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:35.383817    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:35.383978 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:35.383885    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:35.383978 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:35.383948    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:37.383975 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:37.383946    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:37.383975 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:37.383960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:37.383975 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:37.383946    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:37.384395 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:37.384093    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:37.384395 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:37.384122    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:37.384395 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:37.384192    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:39.384146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:39.384113    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:39.384517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:39.384208    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:39.384517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:39.384218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:39.384517 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:39.384219    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:39.384517 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:39.384291    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:39.384517 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:39.384343    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:40.958300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:40.958269    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:41.060545 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:41.060517    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:41.136286 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:41.136262    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:41.383386 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:41.383363    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:41.383532 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:41.383363    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:41.383532 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:41.383489    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:41.383618 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:41.383548    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:41.383618 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:41.383469    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:41.383684 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:41.383630    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:41.390337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:41.390312    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:43.092654 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.092622    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:43.222681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.222653    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:43.363964 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.363934    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:43.384089 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.384062    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:43.384190 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.384176    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:43.384231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.384187    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:43.384231 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:43.384186    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4mcmv" podUID="546b25de-6cb1-4c8c-afbf-74ee5dce1d53"
Sep 10 12:10:43.384309 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:43.384252    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn6sq" podUID="8a9acddb-5d80-44e9-ae12-025daecdbc0e"
Sep 10 12:10:43.384353 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:10:43.384336    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgl6b" podUID="0ef9844d-c3f5-455c-9981-bc39b349ec3c"
Sep 10 12:10:43.475267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.475222    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:43.590495 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.590467    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:43.752645 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.752597    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeReady"
Sep 10 12:10:43.752732 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.752680    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 12:10:43.815414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.815382    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2d9ml"]
Sep 10 12:10:43.822104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.822085    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zzf6x"]
Sep 10 12:10:43.822232 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.822216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:43.825022 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.825007    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 12:10:43.825115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.825007    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwz2g\""
Sep 10 12:10:43.825192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.825172    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 12:10:43.825394 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.825381    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 12:10:43.825799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.825783    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 12:10:43.828261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.828240    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:43.830942 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.830908    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 12:10:43.831044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.830950    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 12:10:43.831107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.831068    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zzf6x"]
Sep 10 12:10:43.831665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.831647    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7696c\""
Sep 10 12:10:43.831766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.831652    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 12:10:43.831766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.831692    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2d9ml"]
Sep 10 12:10:43.852623 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.852605    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dxnhp"]
Sep 10 12:10:43.858009 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.857995    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:43.860375 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.860358    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2gxdf\""
Sep 10 12:10:43.860477 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.860358    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 12:10:43.860637 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.860624    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 12:10:43.866004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.865980    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxnhp"]
Sep 10 12:10:43.905946 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.905926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-crio-socket\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:43.906047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.905961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq7vz\" (UniqueName: \"kubernetes.io/projected/b9184e5e-44a4-41c2-85ed-b76e037c9fa0-kube-api-access-tq7vz\") pod \"ingress-canary-zzf6x\" (UID: \"b9184e5e-44a4-41c2-85ed-b76e037c9fa0\") " pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:43.906047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.905978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:43.906047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.905993    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpc25\" (UniqueName: \"kubernetes.io/projected/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-kube-api-access-dpc25\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:43.906047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906009    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/143a207c-76eb-4a9b-b4d1-cd61360b7230-tmp-dir\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:43.906047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/143a207c-76eb-4a9b-b4d1-cd61360b7230-metrics-tls\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:43.906236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbf5j\" (UniqueName: \"kubernetes.io/projected/143a207c-76eb-4a9b-b4d1-cd61360b7230-kube-api-access-sbf5j\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:43.906236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:43.906236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9184e5e-44a4-41c2-85ed-b76e037c9fa0-cert\") pod \"ingress-canary-zzf6x\" (UID: \"b9184e5e-44a4-41c2-85ed-b76e037c9fa0\") " pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:43.906236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/143a207c-76eb-4a9b-b4d1-cd61360b7230-config-volume\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:43.906236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.906160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-data-volume\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:43.986439 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:43.986405    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:44.006743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq7vz\" (UniqueName: \"kubernetes.io/projected/b9184e5e-44a4-41c2-85ed-b76e037c9fa0-kube-api-access-tq7vz\") pod \"ingress-canary-zzf6x\" (UID: \"b9184e5e-44a4-41c2-85ed-b76e037c9fa0\") " pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:44.006743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.006875 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006748    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpc25\" (UniqueName: \"kubernetes.io/projected/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-kube-api-access-dpc25\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.006875 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/143a207c-76eb-4a9b-b4d1-cd61360b7230-tmp-dir\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.006979 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/143a207c-76eb-4a9b-b4d1-cd61360b7230-metrics-tls\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.006979 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006931    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbf5j\" (UniqueName: \"kubernetes.io/projected/143a207c-76eb-4a9b-b4d1-cd61360b7230-kube-api-access-sbf5j\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.006979 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.006952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.007132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9184e5e-44a4-41c2-85ed-b76e037c9fa0-cert\") pod \"ingress-canary-zzf6x\" (UID: \"b9184e5e-44a4-41c2-85ed-b76e037c9fa0\") " pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:44.007132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007031    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/143a207c-76eb-4a9b-b4d1-cd61360b7230-config-volume\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.007132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-data-volume\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.007132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/143a207c-76eb-4a9b-b4d1-cd61360b7230-tmp-dir\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.007132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-crio-socket\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.007337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-crio-socket\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.007469 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007445    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-data-volume\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.007641 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007622    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.007700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.007622    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/143a207c-76eb-4a9b-b4d1-cd61360b7230-config-volume\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.010851 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.010832    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.010926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.010874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/143a207c-76eb-4a9b-b4d1-cd61360b7230-metrics-tls\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.010968 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.010932    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9184e5e-44a4-41c2-85ed-b76e037c9fa0-cert\") pod \"ingress-canary-zzf6x\" (UID: \"b9184e5e-44a4-41c2-85ed-b76e037c9fa0\") " pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:44.015711 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.015684    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpc25\" (UniqueName: \"kubernetes.io/projected/10bddce8-4267-46bc-bd99-7eedc0c1e2fe-kube-api-access-dpc25\") pod \"insights-runtime-extractor-2d9ml\" (UID: \"10bddce8-4267-46bc-bd99-7eedc0c1e2fe\") " pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.015852 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.015826    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbf5j\" (UniqueName: \"kubernetes.io/projected/143a207c-76eb-4a9b-b4d1-cd61360b7230-kube-api-access-sbf5j\") pod \"dns-default-dxnhp\" (UID: \"143a207c-76eb-4a9b-b4d1-cd61360b7230\") " pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.016146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.016128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq7vz\" (UniqueName: \"kubernetes.io/projected/b9184e5e-44a4-41c2-85ed-b76e037c9fa0-kube-api-access-tq7vz\") pod \"ingress-canary-zzf6x\" (UID: \"b9184e5e-44a4-41c2-85ed-b76e037c9fa0\") " pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:44.055381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.055353    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:44.132020 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.132000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2d9ml"
Sep 10 12:10:44.139126 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.139110    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zzf6x"
Sep 10 12:10:44.165554 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.165535    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:44.481355 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.481318    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2d9ml"]
Sep 10 12:10:44.485497 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:44.485460    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bddce8_4267_46bc_bd99_7eedc0c1e2fe.slice/crio-37fb28431ac7114f261d51083461406a0aaf45cceffa1d0a47d3c469cd81a4fc WatchSource:0}: Error finding container 37fb28431ac7114f261d51083461406a0aaf45cceffa1d0a47d3c469cd81a4fc: Status 404 returned error can't find the container with id 37fb28431ac7114f261d51083461406a0aaf45cceffa1d0a47d3c469cd81a4fc
Sep 10 12:10:44.486493 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.486467    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zzf6x"]
Sep 10 12:10:44.492017 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:44.491988    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9184e5e_44a4_41c2_85ed_b76e037c9fa0.slice/crio-639dd6397988fcecfb5db888e40984221bfb0e2428fe6b94ee3a9606e3eacb75 WatchSource:0}: Error finding container 639dd6397988fcecfb5db888e40984221bfb0e2428fe6b94ee3a9606e3eacb75: Status 404 returned error can't find the container with id 639dd6397988fcecfb5db888e40984221bfb0e2428fe6b94ee3a9606e3eacb75
Sep 10 12:10:44.547811 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.547788    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxnhp"]
Sep 10 12:10:44.551412 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:44.551383    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143a207c_76eb_4a9b_b4d1_cd61360b7230.slice/crio-e5e5d365a5ad47a9e469c5d59db318af58135a051949c05b6181b5d289bc3d16 WatchSource:0}: Error finding container e5e5d365a5ad47a9e469c5d59db318af58135a051949c05b6181b5d289bc3d16: Status 404 returned error can't find the container with id e5e5d365a5ad47a9e469c5d59db318af58135a051949c05b6181b5d289bc3d16
Sep 10 12:10:44.627694 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.627657    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zzf6x" event={"ID":"b9184e5e-44a4-41c2-85ed-b76e037c9fa0","Type":"ContainerStarted","Data":"639dd6397988fcecfb5db888e40984221bfb0e2428fe6b94ee3a9606e3eacb75"}
Sep 10 12:10:44.629579 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.629545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d9ml" event={"ID":"10bddce8-4267-46bc-bd99-7eedc0c1e2fe","Type":"ContainerStarted","Data":"c17ad5543a868a8c8e6b35b7f7c84d52a8f2479c08eb7ca324d760fe082417c3"}
Sep 10 12:10:44.629683 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.629614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d9ml" event={"ID":"10bddce8-4267-46bc-bd99-7eedc0c1e2fe","Type":"ContainerStarted","Data":"37fb28431ac7114f261d51083461406a0aaf45cceffa1d0a47d3c469cd81a4fc"}
Sep 10 12:10:44.630650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:44.630625    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxnhp" event={"ID":"143a207c-76eb-4a9b-b4d1-cd61360b7230","Type":"ContainerStarted","Data":"e5e5d365a5ad47a9e469c5d59db318af58135a051949c05b6181b5d289bc3d16"}
Sep 10 12:10:45.264406 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.264369    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:45.327909 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.327882    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:45.384080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.384048    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:45.384222 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.384048    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:45.384288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.384061    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:45.388367 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.388204    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 12:10:45.388367 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.388239    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 12:10:45.388587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.388204    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpk75\""
Sep 10 12:10:45.388647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.388607    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 12:10:45.388690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.388681    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 12:10:45.388820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.388799    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7mt6m\""
Sep 10 12:10:45.861529 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.861502    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-567c55b9db-84ll9"]
Sep 10 12:10:45.863578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.863558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.867650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.867627    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4h9f5\""
Sep 10 12:10:45.867904 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.867877    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 12:10:45.868364 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.868268    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 12:10:45.868559 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.868506    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 12:10:45.869012 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.868693    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 12:10:45.869012 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.868894    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 12:10:45.869126 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.869072    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 12:10:45.869282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.869265    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 12:10:45.870973 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.870948    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:45.874413 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.874389    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 12:10:45.876360 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.876337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567c55b9db-84ll9"]
Sep 10 12:10:45.920821 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.920800    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-service-ca\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.920934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.920852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-oauth-serving-cert\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.920934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.920880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxpzw\" (UniqueName: \"kubernetes.io/projected/a5d54870-6a88-4827-869c-c4a253dd6ff0-kube-api-access-mxpzw\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.920934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.920911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-oauth-config\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.921097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.920934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-trusted-ca-bundle\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.921097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.920985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-serving-cert\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.921097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.921029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-config\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:45.974389 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:45.974351    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:46.021956 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.021926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-config\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.021981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-service-ca\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-oauth-serving-cert\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxpzw\" (UniqueName: \"kubernetes.io/projected/a5d54870-6a88-4827-869c-c4a253dd6ff0-kube-api-access-mxpzw\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022056    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-oauth-config\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-trusted-ca-bundle\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022350 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022122    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-serving-cert\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.022861 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022833    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-config\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.023041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-oauth-serving-cert\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.023041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.022833    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-service-ca\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.023890 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.023865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-trusted-ca-bundle\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.024930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.024907    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-oauth-config\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.025095 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.025070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-serving-cert\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.034755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.034733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxpzw\" (UniqueName: \"kubernetes.io/projected/a5d54870-6a88-4827-869c-c4a253dd6ff0-kube-api-access-mxpzw\") pod \"console-567c55b9db-84ll9\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") " pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.188950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.188911    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:46.639214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.639166    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d9ml" event={"ID":"10bddce8-4267-46bc-bd99-7eedc0c1e2fe","Type":"ContainerStarted","Data":"fb6ce45d80605e6f6293723066f2262c19854c7597c6426654a091fbeeed1441"}
Sep 10 12:10:46.735863 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.735807    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:46.834681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:46.834648    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:47.568421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:47.568348    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-59wst"
Sep 10 12:10:47.730177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:47.730133    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:47.829413 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:47.829331    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:47.952370 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:47.952338    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567c55b9db-84ll9"]
Sep 10 12:10:47.955549 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:47.955523    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d54870_6a88_4827_869c_c4a253dd6ff0.slice/crio-64909eaf8253877d2af00470be66a3315f211a64deb154416a6def895612055c WatchSource:0}: Error finding container 64909eaf8253877d2af00470be66a3315f211a64deb154416a6def895612055c: Status 404 returned error can't find the container with id 64909eaf8253877d2af00470be66a3315f211a64deb154416a6def895612055c
Sep 10 12:10:48.454137 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.454110    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:48.563245 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.563216    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:48.649202 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.649164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zzf6x" event={"ID":"b9184e5e-44a4-41c2-85ed-b76e037c9fa0","Type":"ContainerStarted","Data":"dd1f903deffc7038b4d6f6204e222735cdcbe29ce5d7fd68d36a0dd174845202"}
Sep 10 12:10:48.651290 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.651262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxnhp" event={"ID":"143a207c-76eb-4a9b-b4d1-cd61360b7230","Type":"ContainerStarted","Data":"c1d9f60d34002d05a52500d329378c2b8640dd5002e8884821d724fb1f88bbee"}
Sep 10 12:10:48.651420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.651308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxnhp" event={"ID":"143a207c-76eb-4a9b-b4d1-cd61360b7230","Type":"ContainerStarted","Data":"aa7b9d39ce623fc7d4fd903cc180df37f5a356ea16811a6a30a32918800073de"}
Sep 10 12:10:48.651420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.651336    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:48.653623 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.653593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d9ml" event={"ID":"10bddce8-4267-46bc-bd99-7eedc0c1e2fe","Type":"ContainerStarted","Data":"237a366b7a170b7ac9cdcd9f138421831b210a347a63188685da925e02751bda"}
Sep 10 12:10:48.654976 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.654955    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c55b9db-84ll9" event={"ID":"a5d54870-6a88-4827-869c-c4a253dd6ff0","Type":"ContainerStarted","Data":"64909eaf8253877d2af00470be66a3315f211a64deb154416a6def895612055c"}
Sep 10 12:10:48.666377 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.666339    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zzf6x" podStartSLOduration=2.487196198 podStartE2EDuration="5.666324986s" totalImagesPullingTime="3.179128788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:48.665522792 +0000 UTC m=+62.759702984" watchObservedRunningTime="2026-09-10 12:10:48.666324986 +0000 UTC m=+62.760505175"
Sep 10 12:10:48.667273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.667251    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:48.684930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.684873    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2d9ml" podStartSLOduration=2.680173601 podStartE2EDuration="5.68485724s" totalImagesPullingTime="3.004683639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:10:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:48.684342412 +0000 UTC m=+62.778522602" watchObservedRunningTime="2026-09-10 12:10:48.68485724 +0000 UTC m=+62.779037434"
Sep 10 12:10:48.703877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:48.703832    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dxnhp" podStartSLOduration=2.584555613 podStartE2EDuration="5.703814527s" totalImagesPullingTime="3.119258914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:48.702648597 +0000 UTC m=+62.796828791" watchObservedRunningTime="2026-09-10 12:10:48.703814527 +0000 UTC m=+62.797994722"
Sep 10 12:10:49.850609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:49.850576    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:49.949489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:49.949441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:51.665404 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:51.665369    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c55b9db-84ll9" event={"ID":"a5d54870-6a88-4827-869c-c4a253dd6ff0","Type":"ContainerStarted","Data":"de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac"}
Sep 10 12:10:51.688636 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:51.688592    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-567c55b9db-84ll9" podStartSLOduration=4.016667462 podStartE2EDuration="6.688574359s" totalImagesPullingTime="2.671906897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:51.686913355 +0000 UTC m=+65.781093546" watchObservedRunningTime="2026-09-10 12:10:51.688574359 +0000 UTC m=+65.782754551"
Sep 10 12:10:52.063936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.063867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:52.067036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.067017    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 12:10:52.076563 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.076545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a9acddb-5d80-44e9-ae12-025daecdbc0e-original-pull-secret\") pod \"global-pull-secret-syncer-xn6sq\" (UID: \"8a9acddb-5d80-44e9-ae12-025daecdbc0e\") " pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:52.164323 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.164299    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:52.164450 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.164331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:52.167105 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.167091    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 12:10:52.167761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.167747    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 12:10:52.176980 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.176962    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/546b25de-6cb1-4c8c-afbf-74ee5dce1d53-metrics-certs\") pod \"network-metrics-daemon-4mcmv\" (UID: \"546b25de-6cb1-4c8c-afbf-74ee5dce1d53\") " pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:52.177690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.177676    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 12:10:52.187143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.187122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmxkq\" (UniqueName: \"kubernetes.io/projected/0ef9844d-c3f5-455c-9981-bc39b349ec3c-kube-api-access-zmxkq\") pod \"network-check-target-cgl6b\" (UID: \"0ef9844d-c3f5-455c-9981-bc39b349ec3c\") " pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:52.298888 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.298867    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7mt6m\""
Sep 10 12:10:52.307234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.307216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4mcmv"
Sep 10 12:10:52.307706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.307690    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpk75\""
Sep 10 12:10:52.311861 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.311848    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn6sq"
Sep 10 12:10:52.316036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.315981    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:52.606922 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.606895    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4mcmv"]
Sep 10 12:10:52.611321 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:52.611294    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546b25de_6cb1_4c8c_afbf_74ee5dce1d53.slice/crio-7f4ad2e5bb12b76cb8a6f5f45a547db40ba07c376972235e280e3710d24eccbb WatchSource:0}: Error finding container 7f4ad2e5bb12b76cb8a6f5f45a547db40ba07c376972235e280e3710d24eccbb: Status 404 returned error can't find the container with id 7f4ad2e5bb12b76cb8a6f5f45a547db40ba07c376972235e280e3710d24eccbb
Sep 10 12:10:52.632623 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.632599    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xn6sq"]
Sep 10 12:10:52.634946 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:52.634919    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9acddb_5d80_44e9_ae12_025daecdbc0e.slice/crio-82105f5b2310fc3e3e54f17529ece4d8c3af89a0fffb4f0f84239e70b46e88b1 WatchSource:0}: Error finding container 82105f5b2310fc3e3e54f17529ece4d8c3af89a0fffb4f0f84239e70b46e88b1: Status 404 returned error can't find the container with id 82105f5b2310fc3e3e54f17529ece4d8c3af89a0fffb4f0f84239e70b46e88b1
Sep 10 12:10:52.656050 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.656028    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cgl6b"]
Sep 10 12:10:52.658632 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:52.658611    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef9844d_c3f5_455c_9981_bc39b349ec3c.slice/crio-79cd2db8fa2602738b1b6dc61473a6c6972640fb36026badcf2569e664b36a55 WatchSource:0}: Error finding container 79cd2db8fa2602738b1b6dc61473a6c6972640fb36026badcf2569e664b36a55: Status 404 returned error can't find the container with id 79cd2db8fa2602738b1b6dc61473a6c6972640fb36026badcf2569e664b36a55
Sep 10 12:10:52.668689 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.668662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cgl6b" event={"ID":"0ef9844d-c3f5-455c-9981-bc39b349ec3c","Type":"ContainerStarted","Data":"79cd2db8fa2602738b1b6dc61473a6c6972640fb36026badcf2569e664b36a55"}
Sep 10 12:10:52.669698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.669677    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xn6sq" event={"ID":"8a9acddb-5d80-44e9-ae12-025daecdbc0e","Type":"ContainerStarted","Data":"82105f5b2310fc3e3e54f17529ece4d8c3af89a0fffb4f0f84239e70b46e88b1"}
Sep 10 12:10:52.670683 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:52.670667    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4mcmv" event={"ID":"546b25de-6cb1-4c8c-afbf-74ee5dce1d53","Type":"ContainerStarted","Data":"7f4ad2e5bb12b76cb8a6f5f45a547db40ba07c376972235e280e3710d24eccbb"}
Sep 10 12:10:54.684915 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:54.684877    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4mcmv" event={"ID":"546b25de-6cb1-4c8c-afbf-74ee5dce1d53","Type":"ContainerStarted","Data":"6cceecb4294de558c0de5f4ecc35a79f7359262a93bfc8e47c7a292e5df24ace"}
Sep 10 12:10:54.685378 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:54.684936    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4mcmv" event={"ID":"546b25de-6cb1-4c8c-afbf-74ee5dce1d53","Type":"ContainerStarted","Data":"e30b1e4f09e804cba7e92d90f4bc056ddb6573ba1bc80d872b0f99186c2a543f"}
Sep 10 12:10:54.702947 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:54.702900    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4mcmv" podStartSLOduration=66.697529802 podStartE2EDuration="1m7.702884045s" totalImagesPullingTime="1.005354243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:54.702048811 +0000 UTC m=+68.796229005" watchObservedRunningTime="2026-09-10 12:10:54.702884045 +0000 UTC m=+68.797064236"
Sep 10 12:10:54.803816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:54.803782    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:54.904836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:54.904804    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:55.159167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.159114    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:55.194597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.194565    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-499r6"]
Sep 10 12:10:55.196435 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.196406    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.199115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.199095    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 12:10:55.200510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.200490    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 12:10:55.200615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.200512    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 12:10:55.200615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.200527    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 12:10:55.200615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.200497    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pfdg8\""
Sep 10 12:10:55.200821 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.200805    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 12:10:55.208185 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.208165    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-499r6"]
Sep 10 12:10:55.233593 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.233574    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:55.285661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.285631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.285784 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.285704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.285784 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.285745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.285784 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.285772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtqh\" (UniqueName: \"kubernetes.io/projected/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-kube-api-access-cjtqh\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.320790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.320768    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:55.386719 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.386686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.386866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.386741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.386866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.386774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtqh\" (UniqueName: \"kubernetes.io/projected/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-kube-api-access-cjtqh\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.386972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.386941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.387556 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.387534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.389678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.389656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.389775 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.389756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.396049 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.396022    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtqh\" (UniqueName: \"kubernetes.io/projected/8d8439d4-f904-4e68-aad9-a4dcddf44ee2-kube-api-access-cjtqh\") pod \"prometheus-operator-6f4946db56-499r6\" (UID: \"8d8439d4-f904-4e68-aad9-a4dcddf44ee2\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.506661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.506601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6"
Sep 10 12:10:55.718334 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.718304    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:55.781625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:55.781547    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:56.189292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:56.189241    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:56.189485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:56.189318    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:56.195469 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:56.195447    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:56.696904 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:56.696869    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:10:56.889015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:56.888973    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:56.988422 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:56.988352    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:57.597253 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.597180    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-499r6"]
Sep 10 12:10:57.599934 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:10:57.599899    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8439d4_f904_4e68_aad9_a4dcddf44ee2.slice/crio-5ca0aa36ad2050a87588128c7566a140b6668ab5ac2807f251ed6b28c7c4abf4 WatchSource:0}: Error finding container 5ca0aa36ad2050a87588128c7566a140b6668ab5ac2807f251ed6b28c7c4abf4: Status 404 returned error can't find the container with id 5ca0aa36ad2050a87588128c7566a140b6668ab5ac2807f251ed6b28c7c4abf4
Sep 10 12:10:57.679964 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.679938    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:57.696571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.696543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xn6sq" event={"ID":"8a9acddb-5d80-44e9-ae12-025daecdbc0e","Type":"ContainerStarted","Data":"54197434751a12ad46b12daf0345e65f9b34434970f4929c0f787ed734e1bb69"}
Sep 10 12:10:57.697738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.697710    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6" event={"ID":"8d8439d4-f904-4e68-aad9-a4dcddf44ee2","Type":"ContainerStarted","Data":"5ca0aa36ad2050a87588128c7566a140b6668ab5ac2807f251ed6b28c7c4abf4"}
Sep 10 12:10:57.699061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.699032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cgl6b" event={"ID":"0ef9844d-c3f5-455c-9981-bc39b349ec3c","Type":"ContainerStarted","Data":"d9c701538768f86a6c226be18733391a5727ad1c100c84e599ec026d88b6e687"}
Sep 10 12:10:57.712700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.712662    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xn6sq" podStartSLOduration=66.003687947 podStartE2EDuration="1m10.712648071s" totalImagesPullingTime="4.708960124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:57.711938672 +0000 UTC m=+71.806118875" watchObservedRunningTime="2026-09-10 12:10:57.712648071 +0000 UTC m=+71.806828257"
Sep 10 12:10:57.728100 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.728063    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cgl6b" podStartSLOduration=66.053662365 podStartE2EDuration="1m10.728054242s" totalImagesPullingTime="4.674391877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:57.727757027 +0000 UTC m=+71.821937219" watchObservedRunningTime="2026-09-10 12:10:57.728054242 +0000 UTC m=+71.822234434"
Sep 10 12:10:57.781322 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:57.781296    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:58.660564 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:58.660542    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dxnhp"
Sep 10 12:10:58.706898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:58.706863    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6" event={"ID":"8d8439d4-f904-4e68-aad9-a4dcddf44ee2","Type":"ContainerStarted","Data":"583a70beb99f8e3303f32d96f7e2a7d79e0b64104f7f9949afe79ae7c6e9e7f2"}
Sep 10 12:10:58.707011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:58.706931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6" event={"ID":"8d8439d4-f904-4e68-aad9-a4dcddf44ee2","Type":"ContainerStarted","Data":"fb6b1db960d571fe69399007575a6f7dd8c0eb5b160930caa4fdb74e14f51977"}
Sep 10 12:10:58.707273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:58.707252    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:10:58.726687 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:58.726634    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-499r6" podStartSLOduration=2.738282778 podStartE2EDuration="3.726614744s" totalImagesPullingTime="988.331966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:58.725222951 +0000 UTC m=+72.819403162" watchObservedRunningTime="2026-09-10 12:10:58.726614744 +0000 UTC m=+72.820794936"
Sep 10 12:10:58.849045 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:58.848970    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:59.017798 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:59.017769    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:59.282702 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:59.282672    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:10:59.349660 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:10:59.349638    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:00.332070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.332037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:00.439501 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.439470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:00.571996 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.571969    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:00.645506 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.645480    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"]
Sep 10 12:11:00.647366 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.647352    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.651231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.651207    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 12:11:00.651231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.651217    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 12:11:00.651406 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.651271    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 12:11:00.651406 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.651286    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j84kl\""
Sep 10 12:11:00.661900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.661879    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"]
Sep 10 12:11:00.666177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.666158    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kntmr"]
Sep 10 12:11:00.668067 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.668053    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.670375 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.670355    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 12:11:00.670505 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.670486    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6pwvt\""
Sep 10 12:11:00.670604 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.670487    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 12:11:00.670777 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.670760    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 12:11:00.723756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1fc675d-0a27-482b-a528-ef9d1301dd67-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.723836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-textfile\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.723836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.723836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-wtmp\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.723963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723837    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-sys\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.723963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7q2z\" (UniqueName: \"kubernetes.io/projected/167f4dc2-0a29-43ed-a906-952df4d340b1-kube-api-access-h7q2z\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.723963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.723963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.724077 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.723995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsb4c\" (UniqueName: \"kubernetes.io/projected/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-api-access-bsb4c\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.724077 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.724017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/167f4dc2-0a29-43ed-a906-952df4d340b1-metrics-client-ca\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.724077 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.724037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-root\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.724077 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.724062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.724206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.724080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.724206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.724094    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-tls\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.724206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.724109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1fc675d-0a27-482b-a528-ef9d1301dd67-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.770070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.770046    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:00.824561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-wtmp\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-sys\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7q2z\" (UniqueName: \"kubernetes.io/projected/167f4dc2-0a29-43ed-a906-952df4d340b1-kube-api-access-h7q2z\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.824700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-sys\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824659    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsb4c\" (UniqueName: \"kubernetes.io/projected/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-api-access-bsb4c\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824722    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-wtmp\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/167f4dc2-0a29-43ed-a906-952df4d340b1-metrics-client-ca\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-root\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824803    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.824898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/167f4dc2-0a29-43ed-a906-952df4d340b1-root\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-tls\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.824980    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1fc675d-0a27-482b-a528-ef9d1301dd67-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1fc675d-0a27-482b-a528-ef9d1301dd67-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-textfile\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825082    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:11:00.825102    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 12:11:00.825243 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:11:00.825175    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-tls podName:167f4dc2-0a29-43ed-a906-952df4d340b1 nodeName:}" failed. No retries permitted until 2026-09-10 12:11:01.325155348 +0000 UTC m=+75.419335534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-tls") pod "node-exporter-kntmr" (UID: "167f4dc2-0a29-43ed-a906-952df4d340b1") : secret "node-exporter-tls" not found
Sep 10 12:11:00.825640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/167f4dc2-0a29-43ed-a906-952df4d340b1-metrics-client-ca\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825609    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825622    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.825755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825666    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1fc675d-0a27-482b-a528-ef9d1301dd67-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.825879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-textfile\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.825981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.825966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1fc675d-0a27-482b-a528-ef9d1301dd67-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.827304 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.827281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.827552 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.827528    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.827654 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.827641    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.834268 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.834246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7q2z\" (UniqueName: \"kubernetes.io/projected/167f4dc2-0a29-43ed-a906-952df4d340b1-kube-api-access-h7q2z\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:00.834548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.834532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsb4c\" (UniqueName: \"kubernetes.io/projected/b1fc675d-0a27-482b-a528-ef9d1301dd67-kube-api-access-bsb4c\") pod \"kube-state-metrics-74cb57df7-pvrlm\" (UID: \"b1fc675d-0a27-482b-a528-ef9d1301dd67\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.870772 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.870751    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:00.955910 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.955857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"
Sep 10 12:11:00.969912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:00.969887    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:01.071473 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.071443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:01.181383 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.181359    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:01.227082 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.227023    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm"]
Sep 10 12:11:01.328519 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.328489    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-tls\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:01.330523 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.330508    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/167f4dc2-0a29-43ed-a906-952df4d340b1-node-exporter-tls\") pod \"node-exporter-kntmr\" (UID: \"167f4dc2-0a29-43ed-a906-952df4d340b1\") " pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:01.576712 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.576621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kntmr"
Sep 10 12:11:01.586505 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:11:01.586479    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167f4dc2_0a29_43ed_a906_952df4d340b1.slice/crio-c69920f519b5017cc7d8331eaf3c12c4198fe9e4f82f05e9f55fb5f6bbaacf40 WatchSource:0}: Error finding container c69920f519b5017cc7d8331eaf3c12c4198fe9e4f82f05e9f55fb5f6bbaacf40: Status 404 returned error can't find the container with id c69920f519b5017cc7d8331eaf3c12c4198fe9e4f82f05e9f55fb5f6bbaacf40
Sep 10 12:11:01.718792 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.718761    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kntmr" event={"ID":"167f4dc2-0a29-43ed-a906-952df4d340b1","Type":"ContainerStarted","Data":"c69920f519b5017cc7d8331eaf3c12c4198fe9e4f82f05e9f55fb5f6bbaacf40"}
Sep 10 12:11:01.720146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:01.720114    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm" event={"ID":"b1fc675d-0a27-482b-a528-ef9d1301dd67","Type":"ContainerStarted","Data":"056efc4665cea593a5b927c387fa80e8ecde847e57d9f982339ed3a7586759f0"}
Sep 10 12:11:02.025265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.025227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:02.091155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.091123    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:02.653008 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.652970    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:02.701291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.701261    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"]
Sep 10 12:11:02.704949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.704929    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.707963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.707941    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 12:11:02.708307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.708287    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n28wl\""
Sep 10 12:11:02.709116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.708709    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 12:11:02.709116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.708750    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 12:11:02.709116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.708763    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 12:11:02.709116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.709010    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e4steo9oc9i0p\""
Sep 10 12:11:02.709116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.709024    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 12:11:02.721726 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.721685    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"]
Sep 10 12:11:02.726960 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.726938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm" event={"ID":"b1fc675d-0a27-482b-a528-ef9d1301dd67","Type":"ContainerStarted","Data":"bbf6d3b9896d15f51c8078828ebf8c7b026b609374f372ea3e690bbf81f8cd53"}
Sep 10 12:11:02.727080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.726992    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm" event={"ID":"b1fc675d-0a27-482b-a528-ef9d1301dd67","Type":"ContainerStarted","Data":"42f79d6d8ec2d5fe8b843963377c5b1f53ff411445c2f7abd103c4d04a977a77"}
Sep 10 12:11:02.727080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.727029    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm" event={"ID":"b1fc675d-0a27-482b-a528-ef9d1301dd67","Type":"ContainerStarted","Data":"6a4ef9075fd46c21abc0fc5425516cb70c15f952f7d6894a1005b01b53efc68a"}
Sep 10 12:11:02.739872 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.739847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.739989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.739886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-grpc-tls\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.739989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.739914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.739989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.739976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22trc\" (UniqueName: \"kubernetes.io/projected/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-kube-api-access-22trc\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.740151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.740029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.740151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.740058    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-tls\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.740151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.740136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.740274 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.740167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-metrics-client-ca\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.762582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.762527    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pvrlm" podStartSLOduration=1.6897425529999999 podStartE2EDuration="2.762505849s" totalImagesPullingTime="1.072763296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:02.760756545 +0000 UTC m=+76.854936739" watchObservedRunningTime="2026-09-10 12:11:02.762505849 +0000 UTC m=+76.856686042"
Sep 10 12:11:02.840789 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.840789 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-metrics-client-ca\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.840968 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.840968 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840870    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-grpc-tls\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.840968 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840892    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.840968 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22trc\" (UniqueName: \"kubernetes.io/projected/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-kube-api-access-22trc\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.841087 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.840990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.841087 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.841008    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-tls\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.842092 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.842056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-metrics-client-ca\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.843830 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.843782    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.843921 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.843861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.843921 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.843909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-tls\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.844313 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.844275    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.844421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.844402    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-grpc-tls\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.844790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.844766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:02.851336 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:02.851314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22trc\" (UniqueName: \"kubernetes.io/projected/b367d18a-57de-4071-9ae3-c2fa90d8bbf9-kube-api-access-22trc\") pod \"thanos-querier-7b5fd8784b-ggprk\" (UID: \"b367d18a-57de-4071-9ae3-c2fa90d8bbf9\") " pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:03.014754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.014729    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:03.288928 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.288902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"]
Sep 10 12:11:03.290820 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:11:03.290796    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb367d18a_57de_4071_9ae3_c2fa90d8bbf9.slice/crio-d45ef8d8bede9bb14977eef484467ba6c02a63f8af53d28be8a841c14a964128 WatchSource:0}: Error finding container d45ef8d8bede9bb14977eef484467ba6c02a63f8af53d28be8a841c14a964128: Status 404 returned error can't find the container with id d45ef8d8bede9bb14977eef484467ba6c02a63f8af53d28be8a841c14a964128
Sep 10 12:11:03.636470 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.636437    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:03.732006 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.731965    2557 generic.go:356] "Generic (PLEG): container finished" podID="167f4dc2-0a29-43ed-a906-952df4d340b1" containerID="85528bc457c3d4e1a178d574e57d336fcae38f8c25987a2b79bdcfd32d4e191b" exitCode=0
Sep 10 12:11:03.732413 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.732054    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kntmr" event={"ID":"167f4dc2-0a29-43ed-a906-952df4d340b1","Type":"ContainerDied","Data":"85528bc457c3d4e1a178d574e57d336fcae38f8c25987a2b79bdcfd32d4e191b"}
Sep 10 12:11:03.733252 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.733231    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"d45ef8d8bede9bb14977eef484467ba6c02a63f8af53d28be8a841c14a964128"}
Sep 10 12:11:03.737314 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.737293    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:03.954659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:03.954576    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:04.252154 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:04.252001    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:04.738943 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:04.738907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kntmr" event={"ID":"167f4dc2-0a29-43ed-a906-952df4d340b1","Type":"ContainerStarted","Data":"d2c02caece34c89d3366c845267bd68979bd96e0a4f88d7138a984c760297cab"}
Sep 10 12:11:04.739339 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:04.738964    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kntmr" event={"ID":"167f4dc2-0a29-43ed-a906-952df4d340b1","Type":"ContainerStarted","Data":"570acce766cbf1cd3fd0c3f55dc4d814ca7ae8ae166202405a11f2d1e476a290"}
Sep 10 12:11:04.760771 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:04.760722    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kntmr" podStartSLOduration=3.340098786 podStartE2EDuration="4.760707887s" totalImagesPullingTime="1.352564399s" totalInitContainerRuntime="68.044702ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:04.758645312 +0000 UTC m=+78.852825508" watchObservedRunningTime="2026-09-10 12:11:04.760707887 +0000 UTC m=+78.854888078"
Sep 10 12:11:04.857620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:04.857577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:04.959980 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:04.959943    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:05.013536 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.013471    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-754dbb677c-zz9j8"]
Sep 10 12:11:05.016719 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.016699    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.021564 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.021541    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 12:11:05.021658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.021593    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 12:11:05.022482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.022465    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 12:11:05.022574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.022465    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7mf0dopgn2mgo\""
Sep 10 12:11:05.022574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.022468    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-255q2\""
Sep 10 12:11:05.022681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.022470    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 12:11:05.030820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.030790    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-754dbb677c-zz9j8"]
Sep 10 12:11:05.055577 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8bt\" (UniqueName: \"kubernetes.io/projected/58de450d-9040-4d9a-995f-cca26e6d93de-kube-api-access-ts8bt\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.055694 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-secret-metrics-server-client-certs\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.055694 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58de450d-9040-4d9a-995f-cca26e6d93de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.055811 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-client-ca-bundle\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.055811 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055734    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/58de450d-9040-4d9a-995f-cca26e6d93de-audit-log\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.055920 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055841    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/58de450d-9040-4d9a-995f-cca26e6d93de-metrics-server-audit-profiles\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.055920 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.055877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-secret-metrics-server-tls\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-secret-metrics-server-tls\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8bt\" (UniqueName: \"kubernetes.io/projected/58de450d-9040-4d9a-995f-cca26e6d93de-kube-api-access-ts8bt\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157156    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-secret-metrics-server-client-certs\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157198    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58de450d-9040-4d9a-995f-cca26e6d93de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-client-ca-bundle\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157254    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/58de450d-9040-4d9a-995f-cca26e6d93de-audit-log\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/58de450d-9040-4d9a-995f-cca26e6d93de-metrics-server-audit-profiles\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157752 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157715    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/58de450d-9040-4d9a-995f-cca26e6d93de-audit-log\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.157962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.157943    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58de450d-9040-4d9a-995f-cca26e6d93de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.158277 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.158260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/58de450d-9040-4d9a-995f-cca26e6d93de-metrics-server-audit-profiles\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.159592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.159568    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-secret-metrics-server-tls\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.160034 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.160015    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-secret-metrics-server-client-certs\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.160165 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.160147    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58de450d-9040-4d9a-995f-cca26e6d93de-client-ca-bundle\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.166626 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.166604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8bt\" (UniqueName: \"kubernetes.io/projected/58de450d-9040-4d9a-995f-cca26e6d93de-kube-api-access-ts8bt\") pod \"metrics-server-754dbb677c-zz9j8\" (UID: \"58de450d-9040-4d9a-995f-cca26e6d93de\") " pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.328902 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.328883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:05.419364 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.419339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:05.450464 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.450413    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"]
Sep 10 12:11:05.453700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.453681    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:05.459447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.456625    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 12:11:05.459447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.457787    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sjl42\""
Sep 10 12:11:05.465649 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.465587    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"]
Sep 10 12:11:05.515373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.515348    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:05.561051 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.560987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlz2\" (UniqueName: \"kubernetes.io/projected/a3304870-747e-4a5c-b7e7-a1fb121f0239-kube-api-access-jwlz2\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:05.561051 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.561039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3304870-747e-4a5c-b7e7-a1fb121f0239-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:05.605004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.604979    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-754dbb677c-zz9j8"]
Sep 10 12:11:05.607800 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:11:05.607776    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58de450d_9040_4d9a_995f_cca26e6d93de.slice/crio-70e05bab5e3a9c3b6d37f0e9456234e1df5e3c3922ad9d327a14412ac317ab5e WatchSource:0}: Error finding container 70e05bab5e3a9c3b6d37f0e9456234e1df5e3c3922ad9d327a14412ac317ab5e: Status 404 returned error can't find the container with id 70e05bab5e3a9c3b6d37f0e9456234e1df5e3c3922ad9d327a14412ac317ab5e
Sep 10 12:11:05.661850 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.661828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlz2\" (UniqueName: \"kubernetes.io/projected/a3304870-747e-4a5c-b7e7-a1fb121f0239-kube-api-access-jwlz2\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:05.661960 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.661873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3304870-747e-4a5c-b7e7-a1fb121f0239-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:05.662001 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:11:05.661984    2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 10 12:11:05.662054 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:11:05.662044    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3304870-747e-4a5c-b7e7-a1fb121f0239-monitoring-plugin-cert podName:a3304870-747e-4a5c-b7e7-a1fb121f0239 nodeName:}" failed. No retries permitted until 2026-09-10 12:11:06.162024895 +0000 UTC m=+80.256205065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a3304870-747e-4a5c-b7e7-a1fb121f0239-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-w4xjc" (UID: "a3304870-747e-4a5c-b7e7-a1fb121f0239") : secret "monitoring-plugin-cert" not found
Sep 10 12:11:05.671144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.671127    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlz2\" (UniqueName: \"kubernetes.io/projected/a3304870-747e-4a5c-b7e7-a1fb121f0239-kube-api-access-jwlz2\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:05.744055 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.744027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"8005b5bffff207273597368a376d0eb7468f466e8a76dcab083093f210835943"}
Sep 10 12:11:05.744356 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.744102    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"b8e1cbf5a2f7e87f42fb0df25683046f961cc64bd6d94823fc485562b4388ed7"}
Sep 10 12:11:05.744356 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.744142    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"a44bebedc4e32d1c14970db4635777e72ca02f35dc83557f8a63c7cfb88280fd"}
Sep 10 12:11:05.745246 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:05.745222    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8" event={"ID":"58de450d-9040-4d9a-995f-cca26e6d93de","Type":"ContainerStarted","Data":"70e05bab5e3a9c3b6d37f0e9456234e1df5e3c3922ad9d327a14412ac317ab5e"}
Sep 10 12:11:06.145551 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.145513    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:06.166592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.166562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3304870-747e-4a5c-b7e7-a1fb121f0239-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:06.169342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.169314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3304870-747e-4a5c-b7e7-a1fb121f0239-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-w4xjc\" (UID: \"a3304870-747e-4a5c-b7e7-a1fb121f0239\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:06.211449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.211413    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:06.368038 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.368012    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:06.646358 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.646299    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"]
Sep 10 12:11:06.650008 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:11:06.649972    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3304870_747e_4a5c_b7e7_a1fb121f0239.slice/crio-fbaedc9b2a15f3795d69f4a6357f9aa6e239b65a5a13bb760ac6fbb14da21ecb WatchSource:0}: Error finding container fbaedc9b2a15f3795d69f4a6357f9aa6e239b65a5a13bb760ac6fbb14da21ecb: Status 404 returned error can't find the container with id fbaedc9b2a15f3795d69f4a6357f9aa6e239b65a5a13bb760ac6fbb14da21ecb
Sep 10 12:11:06.753498 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.753462    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"e735eddb8c4155f3c14b5227e338cca9e324c8ca3747430490d39e452e66e043"}
Sep 10 12:11:06.753949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.753576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"2d1ac206e13652daa512ef711f9baa89e76824db1b72c668e41f8c7e4c4c4cdc"}
Sep 10 12:11:06.753949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.753628    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:06.753949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.753668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" event={"ID":"b367d18a-57de-4071-9ae3-c2fa90d8bbf9","Type":"ContainerStarted","Data":"d347bf94532740aaa46464ed3fb5d3d7b8ca1afa622324ea9fe64ef0e5cb5822"}
Sep 10 12:11:06.754979 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.754958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc" event={"ID":"a3304870-747e-4a5c-b7e7-a1fb121f0239","Type":"ContainerStarted","Data":"fbaedc9b2a15f3795d69f4a6357f9aa6e239b65a5a13bb760ac6fbb14da21ecb"}
Sep 10 12:11:06.781971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.781917    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk" podStartSLOduration=2.01947852 podStartE2EDuration="4.781901176s" totalImagesPullingTime="2.762422656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:06.780763039 +0000 UTC m=+80.874943265" watchObservedRunningTime="2026-09-10 12:11:06.781901176 +0000 UTC m=+80.876081369"
Sep 10 12:11:06.895835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:06.894179    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:07.238182 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:07.238159    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:07.308462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:07.308412    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:07.760805 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:07.760765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8" event={"ID":"58de450d-9040-4d9a-995f-cca26e6d93de","Type":"ContainerStarted","Data":"cf68a972acb94d2a14f2c2f1ed0643f66c78c2eab6376397aadbf115b6f71ed4"}
Sep 10 12:11:07.780246 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:07.780197    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8" podStartSLOduration=2.199753183 podStartE2EDuration="3.780183634s" totalImagesPullingTime="1.580430451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:07.77888279 +0000 UTC m=+81.873062983" watchObservedRunningTime="2026-09-10 12:11:07.780183634 +0000 UTC m=+81.874363826"
Sep 10 12:11:09.261544 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:09.261473    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:09.362912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:09.362888    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:09.769653 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:09.769616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc" event={"ID":"a3304870-747e-4a5c-b7e7-a1fb121f0239","Type":"ContainerStarted","Data":"22a99583bd2f641296bf97da4251abe04f16fe87e335934542f159289fdbe857"}
Sep 10 12:11:09.769845 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:09.769827    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:09.774358 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:09.774336    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc"
Sep 10 12:11:09.788189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:09.788150    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-w4xjc" podStartSLOduration=2.488240544 podStartE2EDuration="4.78813699s" totalImagesPullingTime="2.299896446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:09.786310002 +0000 UTC m=+83.880490193" watchObservedRunningTime="2026-09-10 12:11:09.78813699 +0000 UTC m=+83.882317211"
Sep 10 12:11:10.214750 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:10.214720    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:10.315201 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:10.315166    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:12.767131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:12.767103    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b5fd8784b-ggprk"
Sep 10 12:11:16.313172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:16.313127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:16.413226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:16.413187    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:19.851547 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:19.851509    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:19.911397 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:19.911370    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:20.411728 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:20.411690    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567c55b9db-84ll9"]
Sep 10 12:11:20.594678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:20.594644    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:20.695359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:20.695292    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:25.329340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:25.329307    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:25.329728 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:25.329367    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:29.713273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:29.713245    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cgl6b"
Sep 10 12:11:34.854791 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:34.854750    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:34.916792 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:34.916760    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:35.751907 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:35.751881    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:35.814203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:35.814172    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:39.260019 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:39.259985    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:39.360657 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:39.360630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:39.417670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:39.417646    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:11:45.335603 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.335567    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:45.340639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.340613    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-754dbb677c-zz9j8"
Sep 10 12:11:45.431188 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.431156    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-567c55b9db-84ll9" podUID="a5d54870-6a88-4827-869c-c4a253dd6ff0" containerName="console" containerID="cri-o://de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac" gracePeriod=15
Sep 10 12:11:45.669704 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.669681    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:11:45.739475 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739446    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-oauth-serving-cert\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739604 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739489    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-trusted-ca-bundle\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739604 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739520    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-config\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739635    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-service-ca\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739693    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-oauth-config\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739737    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxpzw\" (UniqueName: \"kubernetes.io/projected/a5d54870-6a88-4827-869c-c4a253dd6ff0-kube-api-access-mxpzw\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739789    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-serving-cert\") pod \"a5d54870-6a88-4827-869c-c4a253dd6ff0\" (UID: \"a5d54870-6a88-4827-869c-c4a253dd6ff0\") "
Sep 10 12:11:45.739919 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739879    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:11:45.739972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739941    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-config" (OuterVolumeSpecName: "console-config") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:11:45.739972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.739947    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:11:45.740043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.740003    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.740043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.740020    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.740043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.740035    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.740043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.740028    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:11:45.741994 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.741960    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:11:45.742085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.742010    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:11:45.742085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.742015    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d54870-6a88-4827-869c-c4a253dd6ff0-kube-api-access-mxpzw" (OuterVolumeSpecName: "kube-api-access-mxpzw") pod "a5d54870-6a88-4827-869c-c4a253dd6ff0" (UID: "a5d54870-6a88-4827-869c-c4a253dd6ff0"). InnerVolumeSpecName "kube-api-access-mxpzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:11:45.840457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.840417    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.840457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.840457    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d54870-6a88-4827-869c-c4a253dd6ff0-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.840574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.840468    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d54870-6a88-4827-869c-c4a253dd6ff0-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.840574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.840476    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxpzw\" (UniqueName: \"kubernetes.io/projected/a5d54870-6a88-4827-869c-c4a253dd6ff0-kube-api-access-mxpzw\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:11:45.896069 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.896046    2557 generic.go:356] "Generic (PLEG): container finished" podID="a5d54870-6a88-4827-869c-c4a253dd6ff0" containerID="de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac" exitCode=0
Sep 10 12:11:45.896165 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.896092    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c55b9db-84ll9"
Sep 10 12:11:45.896165 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.896129    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c55b9db-84ll9" event={"ID":"a5d54870-6a88-4827-869c-c4a253dd6ff0","Type":"ContainerDied","Data":"de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac"}
Sep 10 12:11:45.896244 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.896176    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c55b9db-84ll9" event={"ID":"a5d54870-6a88-4827-869c-c4a253dd6ff0","Type":"ContainerDied","Data":"64909eaf8253877d2af00470be66a3315f211a64deb154416a6def895612055c"}
Sep 10 12:11:45.896244 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.896196    2557 scope.go:117] "RemoveContainer" containerID="de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac"
Sep 10 12:11:45.904370 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.904348    2557 scope.go:117] "RemoveContainer" containerID="de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac"
Sep 10 12:11:45.904649 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:11:45.904629    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac\": container with ID starting with de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac not found: ID does not exist" containerID="de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac"
Sep 10 12:11:45.904722 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.904660    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac"} err="failed to get container status \"de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac\": rpc error: code = NotFound desc = could not find container \"de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac\": container with ID starting with de01106c19ac9d70d7e3fa0f20edf0db6ae18e77f91189c26a665434b233f1ac not found: ID does not exist"
Sep 10 12:11:45.916517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.916499    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567c55b9db-84ll9"]
Sep 10 12:11:45.920589 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:45.920562    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567c55b9db-84ll9"]
Sep 10 12:11:46.388232 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:46.388206    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d54870-6a88-4827-869c-c4a253dd6ff0" path="/var/lib/kubelet/pods/a5d54870-6a88-4827-869c-c4a253dd6ff0/volumes"
Sep 10 12:11:57.469384 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:11:57.469340    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:15.718620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:15.718587    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:16.776321 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:16.776289    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:16.844333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:16.844305    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:22.971192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.971162    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 12:12:22.971820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.971515    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d54870-6a88-4827-869c-c4a253dd6ff0" containerName="console"
Sep 10 12:12:22.971820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.971533    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d54870-6a88-4827-869c-c4a253dd6ff0" containerName="console"
Sep 10 12:12:22.971820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.971590    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d54870-6a88-4827-869c-c4a253dd6ff0" containerName="console"
Sep 10 12:12:22.975091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.975077    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:22.978452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.978416    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 12:12:22.978569 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.978470    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 12:12:22.978569 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.978493    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 12:12:22.978694 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.978625    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 12:12:22.978989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.978970    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 12:12:22.979348 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.979331    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 12:12:22.981140 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.981097    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 12:12:22.981235 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.981173    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 12:12:22.982471 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.982450    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5z2tz\""
Sep 10 12:12:22.985285 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.985267    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 12:12:22.996249 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:22.996231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 12:12:23.075108 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-web-config\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpb75\" (UniqueName: \"kubernetes.io/projected/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-kube-api-access-dpb75\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075251    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-config-volume\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-config-out\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.075580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.075539    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176356 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176334    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpb75\" (UniqueName: \"kubernetes.io/projected/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-kube-api-access-dpb75\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176512    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-config-volume\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-config-out\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-web-config\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.176923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.176803    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.179482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.179415    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.179574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.179538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.179642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.179615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.179642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.179629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-config-volume\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.180011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.179967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.180121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.180097    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.180235 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.180212    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.180321 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.180291    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.180582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.180564    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.180663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.180604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-web-config\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.181457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.181414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-config-out\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.184646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.184625    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpb75\" (UniqueName: \"kubernetes.io/projected/7fbe42ed-ad73-439b-8a17-0c1c2bd06a88-kube-api-access-dpb75\") pod \"alertmanager-main-0\" (UID: \"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.285032 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.284973    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 12:12:23.564520 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:23.564496    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 12:12:23.566799 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:12:23.566772    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbe42ed_ad73_439b_8a17_0c1c2bd06a88.slice/crio-997395c3dd74e1d9f4f662751a1a5929de26e0a76b3be054fe5f6a46d0ff288b WatchSource:0}: Error finding container 997395c3dd74e1d9f4f662751a1a5929de26e0a76b3be054fe5f6a46d0ff288b: Status 404 returned error can't find the container with id 997395c3dd74e1d9f4f662751a1a5929de26e0a76b3be054fe5f6a46d0ff288b
Sep 10 12:12:24.026131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:24.026101    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"997395c3dd74e1d9f4f662751a1a5929de26e0a76b3be054fe5f6a46d0ff288b"}
Sep 10 12:12:25.031467 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:25.031373    2557 generic.go:356] "Generic (PLEG): container finished" podID="7fbe42ed-ad73-439b-8a17-0c1c2bd06a88" containerID="3a419b5eb08bf26c199dcf42857cd5c39a8b4b9e45dd2c8a0374977c7f77143d" exitCode=0
Sep 10 12:12:25.031467 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:25.031415    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerDied","Data":"3a419b5eb08bf26c199dcf42857cd5c39a8b4b9e45dd2c8a0374977c7f77143d"}
Sep 10 12:12:26.544945 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.544907    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6949896564-lggcb"]
Sep 10 12:12:26.548612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.548590    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.551402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.551379    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 12:12:26.551619 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.551600    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 12:12:26.551812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.551797    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 12:12:26.552560 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.552538    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 12:12:26.552675 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.552598    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4h9f5\""
Sep 10 12:12:26.553104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.553079    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 12:12:26.553104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.553092    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 12:12:26.553819 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.553799    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 12:12:26.562901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.561647    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 12:12:26.562901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.561722    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6949896564-lggcb"]
Sep 10 12:12:26.639371 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.639331    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:26.707082 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-config\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.707220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-oauth-serving-cert\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.707220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707141    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8f6d\" (UniqueName: \"kubernetes.io/projected/fa1cae3d-9cf4-4702-ba56-24f080096e55-kube-api-access-h8f6d\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.707220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707159    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-service-ca\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.707220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-trusted-ca-bundle\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.707448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-serving-cert\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.707448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.707305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-oauth-config\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.762818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.762781    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:26.807746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8f6d\" (UniqueName: \"kubernetes.io/projected/fa1cae3d-9cf4-4702-ba56-24f080096e55-kube-api-access-h8f6d\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.807855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-service-ca\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.807855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-trusted-ca-bundle\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.807855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-serving-cert\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.807855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807847    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-oauth-config\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.808055 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807918    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-config\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.808055 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.807945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-oauth-serving-cert\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.808649 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.808621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-service-ca\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.808745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.808689    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-config\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.808745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.808709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-trusted-ca-bundle\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.808745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.808727    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-oauth-serving-cert\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.810586 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.810561    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-oauth-config\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.810782 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.810764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-serving-cert\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.815912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.815892    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8f6d\" (UniqueName: \"kubernetes.io/projected/fa1cae3d-9cf4-4702-ba56-24f080096e55-kube-api-access-h8f6d\") pod \"console-6949896564-lggcb\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") " pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:26.859491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:26.859464    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:27.043399 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:27.043377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"9bb32c3082bccf198dc476db87b0037035abcb4fa6703c7e8ceed788737c6e78"}
Sep 10 12:12:27.043515 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:27.043453    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"afbcf09e9ec903ae59cb28adb6a1db82079316285f631cb99a43121d7540a00f"}
Sep 10 12:12:27.043515 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:27.043480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"5a3fd26f4060201bceeda4d158ac31cfb7028c4f2a2fe3708aa565ea1b6cc7be"}
Sep 10 12:12:27.043515 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:27.043506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"2b2595ee44ac1bcfd4d124c319d2e28c5befee57e668ecf4e9f103f5b9692caa"}
Sep 10 12:12:27.043615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:27.043541    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"1f22b85eacac7958ecf02e32b2e2d202373e265a094987807f53c685cf9ae16f"}
Sep 10 12:12:27.128853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:27.128831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6949896564-lggcb"]
Sep 10 12:12:27.130775 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:12:27.130754    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1cae3d_9cf4_4702_ba56_24f080096e55.slice/crio-f82616fa8a318bc66300b1f157a4614bb03b86a5876174e19c773167d3580fbc WatchSource:0}: Error finding container f82616fa8a318bc66300b1f157a4614bb03b86a5876174e19c773167d3580fbc: Status 404 returned error can't find the container with id f82616fa8a318bc66300b1f157a4614bb03b86a5876174e19c773167d3580fbc
Sep 10 12:12:28.050205 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.050167    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7fbe42ed-ad73-439b-8a17-0c1c2bd06a88","Type":"ContainerStarted","Data":"cbe8ebf7591709ba785f8020ce0ff20ea2124a18df6c2a65777abd58e35dc0fa"}
Sep 10 12:12:28.051700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.051676    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6949896564-lggcb" event={"ID":"fa1cae3d-9cf4-4702-ba56-24f080096e55","Type":"ContainerStarted","Data":"e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9"}
Sep 10 12:12:28.051807 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.051712    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6949896564-lggcb" event={"ID":"fa1cae3d-9cf4-4702-ba56-24f080096e55","Type":"ContainerStarted","Data":"f82616fa8a318bc66300b1f157a4614bb03b86a5876174e19c773167d3580fbc"}
Sep 10 12:12:28.078672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.078632    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.329717758 podStartE2EDuration="6.078616133s" totalImagesPullingTime="2.73066666s" totalInitContainerRuntime="18.231715ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:28.077056306 +0000 UTC m=+162.171236535" watchObservedRunningTime="2026-09-10 12:12:28.078616133 +0000 UTC m=+162.172796325"
Sep 10 12:12:28.096877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.096822    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6949896564-lggcb" podStartSLOduration=2.096803768 podStartE2EDuration="2.096803768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:12:28.096232692 +0000 UTC m=+162.190412885" watchObservedRunningTime="2026-09-10 12:12:28.096803768 +0000 UTC m=+162.190983962"
Sep 10 12:12:28.773604 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.773571    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:28.876880 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:28.876852    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:34.853101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:34.853068    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:34.953554 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:34.953530    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:35.012597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:35.012567    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:36.652598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:36.652568    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:36.859955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:36.859924    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:36.860106 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:36.859975    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:36.864531 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:36.864508    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:37.086349 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:37.086284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:12:37.236347 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:37.236318    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:37.290698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:37.290668    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:37.353579 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:37.353520    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:12:56.941833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:12:56.941764    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:13:36.645793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:36.645760    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:13:36.758742 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:36.758698    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:13:37.290202 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.290170    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"]
Sep 10 12:13:37.293749 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.293728    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.296451 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.296408    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8sj\""
Sep 10 12:13:37.296565 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.296408    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:13:37.297492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.297473    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:13:37.303239 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.303217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"]
Sep 10 12:13:37.393582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.393564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.393674 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.393608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z65n4\" (UniqueName: \"kubernetes.io/projected/e30df3ba-00fd-4655-ae2e-5875cea5d026-kube-api-access-z65n4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.393674 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.393638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.494633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.494601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65n4\" (UniqueName: \"kubernetes.io/projected/e30df3ba-00fd-4655-ae2e-5875cea5d026-kube-api-access-z65n4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.494737 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.494673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.494802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.494736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.495022 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.495003    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.495077 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.495017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.502987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.502968    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z65n4\" (UniqueName: \"kubernetes.io/projected/e30df3ba-00fd-4655-ae2e-5875cea5d026-kube-api-access-z65n4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.602463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.602397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:37.870374 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:37.870352    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"]
Sep 10 12:13:37.872848 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:13:37.872818    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30df3ba_00fd_4655_ae2e_5875cea5d026.slice/crio-a1124fb8258e8e5b70b8ed780785a39853c782c739f0ac587b9638512d93c332 WatchSource:0}: Error finding container a1124fb8258e8e5b70b8ed780785a39853c782c739f0ac587b9638512d93c332: Status 404 returned error can't find the container with id a1124fb8258e8e5b70b8ed780785a39853c782c739f0ac587b9638512d93c332
Sep 10 12:13:38.297855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:38.297786    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn" event={"ID":"e30df3ba-00fd-4655-ae2e-5875cea5d026","Type":"ContainerStarted","Data":"a1124fb8258e8e5b70b8ed780785a39853c782c739f0ac587b9638512d93c332"}
Sep 10 12:13:45.324757 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:45.324728    2557 generic.go:356] "Generic (PLEG): container finished" podID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerID="8c9202da2ae8f87a2a75117d49b5a67bc509edcf51ddc659e91609a4f7f735c1" exitCode=0
Sep 10 12:13:45.325189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:45.324802    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn" event={"ID":"e30df3ba-00fd-4655-ae2e-5875cea5d026","Type":"ContainerDied","Data":"8c9202da2ae8f87a2a75117d49b5a67bc509edcf51ddc659e91609a4f7f735c1"}
Sep 10 12:13:48.337478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:48.337443    2557 generic.go:356] "Generic (PLEG): container finished" podID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerID="3c236257f2a667b0ac44dc135b02ba36b24aaf8e70dd4b2c8de05d0b962cc6f3" exitCode=0
Sep 10 12:13:48.337773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:48.337517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn" event={"ID":"e30df3ba-00fd-4655-ae2e-5875cea5d026","Type":"ContainerDied","Data":"3c236257f2a667b0ac44dc135b02ba36b24aaf8e70dd4b2c8de05d0b962cc6f3"}
Sep 10 12:13:55.368033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:55.367996    2557 generic.go:356] "Generic (PLEG): container finished" podID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerID="8921ba0a3fc7c86f7006af534dc171568a8dd5a7cae40fa7353756e29403610c" exitCode=0
Sep 10 12:13:55.368460 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:55.368039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn" event={"ID":"e30df3ba-00fd-4655-ae2e-5875cea5d026","Type":"ContainerDied","Data":"8921ba0a3fc7c86f7006af534dc171568a8dd5a7cae40fa7353756e29403610c"}
Sep 10 12:13:56.492066 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.492043    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:56.644939 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.644883    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z65n4\" (UniqueName: \"kubernetes.io/projected/e30df3ba-00fd-4655-ae2e-5875cea5d026-kube-api-access-z65n4\") pod \"e30df3ba-00fd-4655-ae2e-5875cea5d026\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") "
Sep 10 12:13:56.645047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.644957    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-util\") pod \"e30df3ba-00fd-4655-ae2e-5875cea5d026\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") "
Sep 10 12:13:56.645047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.645002    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-bundle\") pod \"e30df3ba-00fd-4655-ae2e-5875cea5d026\" (UID: \"e30df3ba-00fd-4655-ae2e-5875cea5d026\") "
Sep 10 12:13:56.645659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.645634    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-bundle" (OuterVolumeSpecName: "bundle") pod "e30df3ba-00fd-4655-ae2e-5875cea5d026" (UID: "e30df3ba-00fd-4655-ae2e-5875cea5d026"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:13:56.646926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.646902    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30df3ba-00fd-4655-ae2e-5875cea5d026-kube-api-access-z65n4" (OuterVolumeSpecName: "kube-api-access-z65n4") pod "e30df3ba-00fd-4655-ae2e-5875cea5d026" (UID: "e30df3ba-00fd-4655-ae2e-5875cea5d026"). InnerVolumeSpecName "kube-api-access-z65n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:13:56.648780 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.648760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-util" (OuterVolumeSpecName: "util") pod "e30df3ba-00fd-4655-ae2e-5875cea5d026" (UID: "e30df3ba-00fd-4655-ae2e-5875cea5d026"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:13:56.745420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.745400    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:13:56.745420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.745420    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z65n4\" (UniqueName: \"kubernetes.io/projected/e30df3ba-00fd-4655-ae2e-5875cea5d026-kube-api-access-z65n4\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:13:56.745556 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:56.745450    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e30df3ba-00fd-4655-ae2e-5875cea5d026-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:13:57.376638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:57.376612    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn"
Sep 10 12:13:57.376638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:57.376620    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754098ndn" event={"ID":"e30df3ba-00fd-4655-ae2e-5875cea5d026","Type":"ContainerDied","Data":"a1124fb8258e8e5b70b8ed780785a39853c782c739f0ac587b9638512d93c332"}
Sep 10 12:13:57.376811 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:13:57.376656    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1124fb8258e8e5b70b8ed780785a39853c782c739f0ac587b9638512d93c332"
Sep 10 12:14:03.331503 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:03.331468    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:04.334179 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:04.334149    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:05.314132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314102    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"]
Sep 10 12:14:05.314397 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314385    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="extract"
Sep 10 12:14:05.314463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314398    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="extract"
Sep 10 12:14:05.314463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314415    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="pull"
Sep 10 12:14:05.314463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314420    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="pull"
Sep 10 12:14:05.314463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314447    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="util"
Sep 10 12:14:05.314463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314454    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="util"
Sep 10 12:14:05.314621 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.314498    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30df3ba-00fd-4655-ae2e-5875cea5d026" containerName="extract"
Sep 10 12:14:05.317950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.317931    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.320398 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.320371    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 12:14:05.320520 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.320442    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vh4nn\""
Sep 10 12:14:05.320634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.320618    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:14:05.330474 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.330452    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"]
Sep 10 12:14:05.504733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.504699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mj6g\" (UniqueName: \"kubernetes.io/projected/f7e7d46c-d75d-406b-9722-a7e008b42f6d-kube-api-access-4mj6g\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlrth\" (UID: \"f7e7d46c-d75d-406b-9722-a7e008b42f6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.505170 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.504823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7e7d46c-d75d-406b-9722-a7e008b42f6d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlrth\" (UID: \"f7e7d46c-d75d-406b-9722-a7e008b42f6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.605288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.605224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7e7d46c-d75d-406b-9722-a7e008b42f6d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlrth\" (UID: \"f7e7d46c-d75d-406b-9722-a7e008b42f6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.605288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.605267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mj6g\" (UniqueName: \"kubernetes.io/projected/f7e7d46c-d75d-406b-9722-a7e008b42f6d-kube-api-access-4mj6g\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlrth\" (UID: \"f7e7d46c-d75d-406b-9722-a7e008b42f6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.605580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.605562    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7e7d46c-d75d-406b-9722-a7e008b42f6d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlrth\" (UID: \"f7e7d46c-d75d-406b-9722-a7e008b42f6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.619449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.619405    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mj6g\" (UniqueName: \"kubernetes.io/projected/f7e7d46c-d75d-406b-9722-a7e008b42f6d-kube-api-access-4mj6g\") pod \"cert-manager-operator-controller-manager-55c444bf86-mlrth\" (UID: \"f7e7d46c-d75d-406b-9722-a7e008b42f6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.626146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.626125    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"
Sep 10 12:14:05.902748 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:05.902718    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth"]
Sep 10 12:14:05.906118 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:05.906095    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e7d46c_d75d_406b_9722_a7e008b42f6d.slice/crio-91fbdb3b491939bae7c1c725a6a361daf28b374fe887e5ac839a99ba2e3985a6 WatchSource:0}: Error finding container 91fbdb3b491939bae7c1c725a6a361daf28b374fe887e5ac839a99ba2e3985a6: Status 404 returned error can't find the container with id 91fbdb3b491939bae7c1c725a6a361daf28b374fe887e5ac839a99ba2e3985a6
Sep 10 12:14:06.405267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:06.405238    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth" event={"ID":"f7e7d46c-d75d-406b-9722-a7e008b42f6d","Type":"ContainerStarted","Data":"91fbdb3b491939bae7c1c725a6a361daf28b374fe887e5ac839a99ba2e3985a6"}
Sep 10 12:14:06.962189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:06.962156    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:07.412166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:07.412134    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth" event={"ID":"f7e7d46c-d75d-406b-9722-a7e008b42f6d","Type":"ContainerStarted","Data":"823083cc0593ed8eb7b107394c4361f6cf0359be3005f5405ecb43490e50395e"}
Sep 10 12:14:07.437847 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:07.437805    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mlrth" podStartSLOduration=1.073718437 podStartE2EDuration="2.43778783s" totalImagesPullingTime="1.364069393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:07.435495773 +0000 UTC m=+261.529675963" watchObservedRunningTime="2026-09-10 12:14:07.43778783 +0000 UTC m=+261.531968024"
Sep 10 12:14:07.681053 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:07.681024    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:07.828597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:07.828564    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:07.971923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:07.971837    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:08.830910 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.830837    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"]
Sep 10 12:14:08.832992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.832978    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:08.836146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.836123    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:14:08.836262 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.836154    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8sj\""
Sep 10 12:14:08.837094 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.837078    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:14:08.839236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.839022    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:08.851591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.851570    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"]
Sep 10 12:14:08.924951 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.924921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:08.925056 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.924962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml86z\" (UniqueName: \"kubernetes.io/projected/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-kube-api-access-ml86z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:08.925056 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.924992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:08.939458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:08.939411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:09.026061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.026040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.026323 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.026075    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml86z\" (UniqueName: \"kubernetes.io/projected/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-kube-api-access-ml86z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.026323 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.026094    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.026447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.026419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.026486 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.026452    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.048242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.048219    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml86z\" (UniqueName: \"kubernetes.io/projected/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-kube-api-access-ml86z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.141380 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.141352    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:09.410935 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.410882    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"]
Sep 10 12:14:09.412955 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:09.412914    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0aa23e8_7348_4e9f_8caa_786ae0790f3f.slice/crio-337640cad381c5d8ff9af9eb7cfcb6d385e241a932f0eb13935f511dbbde4cc4 WatchSource:0}: Error finding container 337640cad381c5d8ff9af9eb7cfcb6d385e241a932f0eb13935f511dbbde4cc4: Status 404 returned error can't find the container with id 337640cad381c5d8ff9af9eb7cfcb6d385e241a932f0eb13935f511dbbde4cc4
Sep 10 12:14:09.420122 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:09.420096    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph" event={"ID":"d0aa23e8-7348-4e9f-8caa-786ae0790f3f","Type":"ContainerStarted","Data":"337640cad381c5d8ff9af9eb7cfcb6d385e241a932f0eb13935f511dbbde4cc4"}
Sep 10 12:14:10.425358 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:10.425324    2557 generic.go:356] "Generic (PLEG): container finished" podID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerID="69d363f83663ba1086ba552964436895951518597cb5bca66392e07bf8914227" exitCode=0
Sep 10 12:14:10.425705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:10.425395    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph" event={"ID":"d0aa23e8-7348-4e9f-8caa-786ae0790f3f","Type":"ContainerDied","Data":"69d363f83663ba1086ba552964436895951518597cb5bca66392e07bf8914227"}
Sep 10 12:14:11.114052 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.114002    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-75tn6"]
Sep 10 12:14:11.116465 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.116410    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.119193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.119173    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 12:14:11.120156 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.120139    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-t2zwc\""
Sep 10 12:14:11.120248 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.120191    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 12:14:11.127724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.127702    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-75tn6"]
Sep 10 12:14:11.139151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.139114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfggv\" (UniqueName: \"kubernetes.io/projected/fe007d1d-f348-42f1-8d2b-fbe92ebfce3f-kube-api-access-sfggv\") pod \"cert-manager-webhook-6486ffd997-75tn6\" (UID: \"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.139444 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.139325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe007d1d-f348-42f1-8d2b-fbe92ebfce3f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-75tn6\" (UID: \"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.208124 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.208097    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:11.239898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.239872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfggv\" (UniqueName: \"kubernetes.io/projected/fe007d1d-f348-42f1-8d2b-fbe92ebfce3f-kube-api-access-sfggv\") pod \"cert-manager-webhook-6486ffd997-75tn6\" (UID: \"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.240026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.239928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe007d1d-f348-42f1-8d2b-fbe92ebfce3f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-75tn6\" (UID: \"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.248856 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.248836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe007d1d-f348-42f1-8d2b-fbe92ebfce3f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-75tn6\" (UID: \"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.249118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.249102    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfggv\" (UniqueName: \"kubernetes.io/projected/fe007d1d-f348-42f1-8d2b-fbe92ebfce3f-kube-api-access-sfggv\") pod \"cert-manager-webhook-6486ffd997-75tn6\" (UID: \"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.413273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.413180    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:11.434188 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.434163    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:11.732411 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.732386    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-75tn6"]
Sep 10 12:14:11.806812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.806782    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"]
Sep 10 12:14:11.812018 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.811993    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:11.815422 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.815319    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ls47f\""
Sep 10 12:14:11.822783 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.822761    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"]
Sep 10 12:14:11.844319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.844292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/307255bc-4364-453b-ba9c-0b3b6d98a8b6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d7q9p\" (UID: \"307255bc-4364-453b-ba9c-0b3b6d98a8b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:11.844443 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.844337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rb7m\" (UniqueName: \"kubernetes.io/projected/307255bc-4364-453b-ba9c-0b3b6d98a8b6-kube-api-access-4rb7m\") pod \"cert-manager-cainjector-559cdd8c87-d7q9p\" (UID: \"307255bc-4364-453b-ba9c-0b3b6d98a8b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:11.944799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.944765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/307255bc-4364-453b-ba9c-0b3b6d98a8b6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d7q9p\" (UID: \"307255bc-4364-453b-ba9c-0b3b6d98a8b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:11.944965 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.944809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rb7m\" (UniqueName: \"kubernetes.io/projected/307255bc-4364-453b-ba9c-0b3b6d98a8b6-kube-api-access-4rb7m\") pod \"cert-manager-cainjector-559cdd8c87-d7q9p\" (UID: \"307255bc-4364-453b-ba9c-0b3b6d98a8b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:11.956403 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.956379    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/307255bc-4364-453b-ba9c-0b3b6d98a8b6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d7q9p\" (UID: \"307255bc-4364-453b-ba9c-0b3b6d98a8b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:11.956581 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:11.956561    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rb7m\" (UniqueName: \"kubernetes.io/projected/307255bc-4364-453b-ba9c-0b3b6d98a8b6-kube-api-access-4rb7m\") pod \"cert-manager-cainjector-559cdd8c87-d7q9p\" (UID: \"307255bc-4364-453b-ba9c-0b3b6d98a8b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:12.124013 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:12.123980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"
Sep 10 12:14:12.235086 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:12.235047    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe007d1d_f348_42f1_8d2b_fbe92ebfce3f.slice/crio-aec575ceeca17ebf03bb5c3ad0584b03776074221f71ea72973c2419f57be2df WatchSource:0}: Error finding container aec575ceeca17ebf03bb5c3ad0584b03776074221f71ea72973c2419f57be2df: Status 404 returned error can't find the container with id aec575ceeca17ebf03bb5c3ad0584b03776074221f71ea72973c2419f57be2df
Sep 10 12:14:12.440281 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:12.440254    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6" event={"ID":"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f","Type":"ContainerStarted","Data":"aec575ceeca17ebf03bb5c3ad0584b03776074221f71ea72973c2419f57be2df"}
Sep 10 12:14:12.441942 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:12.441920    2557 generic.go:356] "Generic (PLEG): container finished" podID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerID="772a49481acb1fead7279d7fe2abec0b244a0e2dbcb5b96e8251b5befafcc10c" exitCode=0
Sep 10 12:14:12.442025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:12.441951    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph" event={"ID":"d0aa23e8-7348-4e9f-8caa-786ae0790f3f","Type":"ContainerDied","Data":"772a49481acb1fead7279d7fe2abec0b244a0e2dbcb5b96e8251b5befafcc10c"}
Sep 10 12:14:12.536090 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:12.536062    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p"]
Sep 10 12:14:12.537619 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:12.537591    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod307255bc_4364_453b_ba9c_0b3b6d98a8b6.slice/crio-77abe353894a861e4891b942affe3f77ed12e96fe190ad55bc26d49e1f66a84e WatchSource:0}: Error finding container 77abe353894a861e4891b942affe3f77ed12e96fe190ad55bc26d49e1f66a84e: Status 404 returned error can't find the container with id 77abe353894a861e4891b942affe3f77ed12e96fe190ad55bc26d49e1f66a84e
Sep 10 12:14:13.450125 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:13.449994    2557 generic.go:356] "Generic (PLEG): container finished" podID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerID="4f98358c0178dfbe18576956ea9a5c52cce0ab0e4ecfc09c4d4c4b813f3f615c" exitCode=0
Sep 10 12:14:13.450125 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:13.450079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph" event={"ID":"d0aa23e8-7348-4e9f-8caa-786ae0790f3f","Type":"ContainerDied","Data":"4f98358c0178dfbe18576956ea9a5c52cce0ab0e4ecfc09c4d4c4b813f3f615c"}
Sep 10 12:14:13.451901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:13.451848    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p" event={"ID":"307255bc-4364-453b-ba9c-0b3b6d98a8b6","Type":"ContainerStarted","Data":"77abe353894a861e4891b942affe3f77ed12e96fe190ad55bc26d49e1f66a84e"}
Sep 10 12:14:14.518516 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.518415    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:14.751344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.751268    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:14.877612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.877592    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:14.964987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.964964    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml86z\" (UniqueName: \"kubernetes.io/projected/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-kube-api-access-ml86z\") pod \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") "
Sep 10 12:14:14.965101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.965033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-bundle\") pod \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") "
Sep 10 12:14:14.965101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.965091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-util\") pod \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\" (UID: \"d0aa23e8-7348-4e9f-8caa-786ae0790f3f\") "
Sep 10 12:14:14.965787 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.965743    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-bundle" (OuterVolumeSpecName: "bundle") pod "d0aa23e8-7348-4e9f-8caa-786ae0790f3f" (UID: "d0aa23e8-7348-4e9f-8caa-786ae0790f3f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:14:14.967257 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.967235    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-kube-api-access-ml86z" (OuterVolumeSpecName: "kube-api-access-ml86z") pod "d0aa23e8-7348-4e9f-8caa-786ae0790f3f" (UID: "d0aa23e8-7348-4e9f-8caa-786ae0790f3f"). InnerVolumeSpecName "kube-api-access-ml86z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:14:14.969266 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:14.969239    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-util" (OuterVolumeSpecName: "util") pod "d0aa23e8-7348-4e9f-8caa-786ae0790f3f" (UID: "d0aa23e8-7348-4e9f-8caa-786ae0790f3f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:14:15.066382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.066351    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:15.066382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.066376    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:15.066382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.066386    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml86z\" (UniqueName: \"kubernetes.io/projected/d0aa23e8-7348-4e9f-8caa-786ae0790f3f-kube-api-access-ml86z\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:15.464435 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.464392    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph"
Sep 10 12:14:15.464435 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.464395    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6b8ph" event={"ID":"d0aa23e8-7348-4e9f-8caa-786ae0790f3f","Type":"ContainerDied","Data":"337640cad381c5d8ff9af9eb7cfcb6d385e241a932f0eb13935f511dbbde4cc4"}
Sep 10 12:14:15.464657 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.464483    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="337640cad381c5d8ff9af9eb7cfcb6d385e241a932f0eb13935f511dbbde4cc4"
Sep 10 12:14:15.466095 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.466061    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6" event={"ID":"fe007d1d-f348-42f1-8d2b-fbe92ebfce3f","Type":"ContainerStarted","Data":"27ae0679ed5c354a5ef16c8dd827596deb414dd073f7cfcee58d633053c0ef9c"}
Sep 10 12:14:15.466220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.466139    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:15.467806 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.467785    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p" event={"ID":"307255bc-4364-453b-ba9c-0b3b6d98a8b6","Type":"ContainerStarted","Data":"270b1e96f972f0dca00de770ddbdf787c9f04e7fd1012ef7e3d94fb45372c705"}
Sep 10 12:14:15.483131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.483083    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6" podStartSLOduration=1.775189182 podStartE2EDuration="4.483071927s" totalImagesPullingTime="2.707882745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:15.482107694 +0000 UTC m=+269.576288071" watchObservedRunningTime="2026-09-10 12:14:15.483071927 +0000 UTC m=+269.577252119"
Sep 10 12:14:15.503472 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:15.503414    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d7q9p" podStartSLOduration=2.091996278 podStartE2EDuration="4.503403217s" totalImagesPullingTime="2.411406939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:15.502021419 +0000 UTC m=+269.596201728" watchObservedRunningTime="2026-09-10 12:14:15.503403217 +0000 UTC m=+269.597583407"
Sep 10 12:14:19.695624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:19.695592    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:19.795765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:19.795738    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:21.474133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:21.474105    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-75tn6"
Sep 10 12:14:22.017285 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017249    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"]
Sep 10 12:14:22.017632 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017615    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="pull"
Sep 10 12:14:22.017718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017635    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="pull"
Sep 10 12:14:22.017718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017655    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="extract"
Sep 10 12:14:22.017718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017663    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="extract"
Sep 10 12:14:22.017718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017676    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="util"
Sep 10 12:14:22.017718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017684    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="util"
Sep 10 12:14:22.017947 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.017781    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0aa23e8-7348-4e9f-8caa-786ae0790f3f" containerName="extract"
Sep 10 12:14:22.020879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.020860    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.025591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.025570    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 12:14:22.025757 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.025738    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lkdrq\""
Sep 10 12:14:22.026114 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.026095    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 12:14:22.037267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.037245    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"]
Sep 10 12:14:22.120981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.120961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07b7f0c1-0e18-4423-9ac6-0e95cb2663a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lwbtk\" (UID: \"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.121067 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.121005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csqht\" (UniqueName: \"kubernetes.io/projected/07b7f0c1-0e18-4423-9ac6-0e95cb2663a0-kube-api-access-csqht\") pod \"openshift-lws-operator-fd8ccff4c-lwbtk\" (UID: \"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.222036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.222011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07b7f0c1-0e18-4423-9ac6-0e95cb2663a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lwbtk\" (UID: \"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.222140 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.222078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csqht\" (UniqueName: \"kubernetes.io/projected/07b7f0c1-0e18-4423-9ac6-0e95cb2663a0-kube-api-access-csqht\") pod \"openshift-lws-operator-fd8ccff4c-lwbtk\" (UID: \"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.222357 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.222340    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07b7f0c1-0e18-4423-9ac6-0e95cb2663a0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lwbtk\" (UID: \"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.231462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.231439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csqht\" (UniqueName: \"kubernetes.io/projected/07b7f0c1-0e18-4423-9ac6-0e95cb2663a0-kube-api-access-csqht\") pod \"openshift-lws-operator-fd8ccff4c-lwbtk\" (UID: \"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.329388 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.329343    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"
Sep 10 12:14:22.595125 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:22.595093    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk"]
Sep 10 12:14:22.597264 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:22.597238    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07b7f0c1_0e18_4423_9ac6_0e95cb2663a0.slice/crio-a2db6fc72bd90107360ec5f96418293b2be5f048ca20d61385d90e738ba62cca WatchSource:0}: Error finding container a2db6fc72bd90107360ec5f96418293b2be5f048ca20d61385d90e738ba62cca: Status 404 returned error can't find the container with id a2db6fc72bd90107360ec5f96418293b2be5f048ca20d61385d90e738ba62cca
Sep 10 12:14:23.506826 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:23.506789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk" event={"ID":"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0","Type":"ContainerStarted","Data":"a2db6fc72bd90107360ec5f96418293b2be5f048ca20d61385d90e738ba62cca"}
Sep 10 12:14:24.513054 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:24.513019    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk" event={"ID":"07b7f0c1-0e18-4423-9ac6-0e95cb2663a0","Type":"ContainerStarted","Data":"d31bffa01a1d7b72021472324ae9c716a567f6802dc678e7c045817a76dc49c3"}
Sep 10 12:14:25.340870 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:25.340831    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:25.483322 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:25.483296    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:27.268941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:27.268912    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:29.600624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.600572    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwbtk" podStartSLOduration=7.12114409 podStartE2EDuration="8.600557303s" totalImagesPullingTime="1.479413213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:24.537896622 +0000 UTC m=+278.632076813" watchObservedRunningTime="2026-09-10 12:14:29.600557303 +0000 UTC m=+283.694737494"
Sep 10 12:14:29.600973 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.600795    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"]
Sep 10 12:14:29.603217 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.603202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.606582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.606562    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:14:29.607029 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.607012    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:14:29.608528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.608509    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8sj\""
Sep 10 12:14:29.621027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.621006    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"]
Sep 10 12:14:29.675708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.675680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.675800 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.675715    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9dtt\" (UniqueName: \"kubernetes.io/projected/eb9f9f28-4b09-4295-a579-b8a743ceebb6-kube-api-access-w9dtt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.675800 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.675745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.776342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.776320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.776530 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.776356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9dtt\" (UniqueName: \"kubernetes.io/projected/eb9f9f28-4b09-4295-a579-b8a743ceebb6-kube-api-access-w9dtt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.776530 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.776386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.776670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.776655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.776735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.776718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.785446 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.785403    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9dtt\" (UniqueName: \"kubernetes.io/projected/eb9f9f28-4b09-4295-a579-b8a743ceebb6-kube-api-access-w9dtt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:29.912131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:29.912108    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:30.184582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:30.184515    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"]
Sep 10 12:14:30.187365 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:30.187331    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f9f28_4b09_4295_a579_b8a743ceebb6.slice/crio-5648eb298411b998058061fedc8bd0d102ead9f81cd5c34b56667b5486773144 WatchSource:0}: Error finding container 5648eb298411b998058061fedc8bd0d102ead9f81cd5c34b56667b5486773144: Status 404 returned error can't find the container with id 5648eb298411b998058061fedc8bd0d102ead9f81cd5c34b56667b5486773144
Sep 10 12:14:30.538719 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:30.538648    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerID="db6c9c646158cb06a1aeeb93c613507f51d53c32cd6755270587dad2d49bd6cc" exitCode=0
Sep 10 12:14:30.538719 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:30.538683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55" event={"ID":"eb9f9f28-4b09-4295-a579-b8a743ceebb6","Type":"ContainerDied","Data":"db6c9c646158cb06a1aeeb93c613507f51d53c32cd6755270587dad2d49bd6cc"}
Sep 10 12:14:30.538719 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:30.538717    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55" event={"ID":"eb9f9f28-4b09-4295-a579-b8a743ceebb6","Type":"ContainerStarted","Data":"5648eb298411b998058061fedc8bd0d102ead9f81cd5c34b56667b5486773144"}
Sep 10 12:14:31.545071 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:31.545043    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerID="0e152fb7d14870f9a2855997bfa1490e65485accd189f492777b5ce80f4adb02" exitCode=0
Sep 10 12:14:31.545386 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:31.545087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55" event={"ID":"eb9f9f28-4b09-4295-a579-b8a743ceebb6","Type":"ContainerDied","Data":"0e152fb7d14870f9a2855997bfa1490e65485accd189f492777b5ce80f4adb02"}
Sep 10 12:14:32.550672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:32.550637    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerID="1acd332e7508bf536d2956dacd5f523cd7a134aa4ca8f9a4bdddd0bf2cfe5130" exitCode=0
Sep 10 12:14:32.551023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:32.550678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55" event={"ID":"eb9f9f28-4b09-4295-a579-b8a743ceebb6","Type":"ContainerDied","Data":"1acd332e7508bf536d2956dacd5f523cd7a134aa4ca8f9a4bdddd0bf2cfe5130"}
Sep 10 12:14:33.674472 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.674449    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:33.807782 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.807758    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-util\") pod \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") "
Sep 10 12:14:33.807933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.807799    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-bundle\") pod \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") "
Sep 10 12:14:33.807933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.807839    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9dtt\" (UniqueName: \"kubernetes.io/projected/eb9f9f28-4b09-4295-a579-b8a743ceebb6-kube-api-access-w9dtt\") pod \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\" (UID: \"eb9f9f28-4b09-4295-a579-b8a743ceebb6\") "
Sep 10 12:14:33.808487 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.808459    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-bundle" (OuterVolumeSpecName: "bundle") pod "eb9f9f28-4b09-4295-a579-b8a743ceebb6" (UID: "eb9f9f28-4b09-4295-a579-b8a743ceebb6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:14:33.809843 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.809783    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9f9f28-4b09-4295-a579-b8a743ceebb6-kube-api-access-w9dtt" (OuterVolumeSpecName: "kube-api-access-w9dtt") pod "eb9f9f28-4b09-4295-a579-b8a743ceebb6" (UID: "eb9f9f28-4b09-4295-a579-b8a743ceebb6"). InnerVolumeSpecName "kube-api-access-w9dtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:14:33.813309 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.813282    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-util" (OuterVolumeSpecName: "util") pod "eb9f9f28-4b09-4295-a579-b8a743ceebb6" (UID: "eb9f9f28-4b09-4295-a579-b8a743ceebb6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:14:33.909220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.909196    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:33.909292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.909235    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb9f9f28-4b09-4295-a579-b8a743ceebb6-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:33.909292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:33.909245    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9dtt\" (UniqueName: \"kubernetes.io/projected/eb9f9f28-4b09-4295-a579-b8a743ceebb6-kube-api-access-w9dtt\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:34.561591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:34.561561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55" event={"ID":"eb9f9f28-4b09-4295-a579-b8a743ceebb6","Type":"ContainerDied","Data":"5648eb298411b998058061fedc8bd0d102ead9f81cd5c34b56667b5486773144"}
Sep 10 12:14:34.561591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:34.561582    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxb55"
Sep 10 12:14:34.561759 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:34.561606    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5648eb298411b998058061fedc8bd0d102ead9f81cd5c34b56667b5486773144"
Sep 10 12:14:40.211962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.211931    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"]
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212230    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="pull"
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212241    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="pull"
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212253    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="util"
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212258    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="util"
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212274    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="extract"
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212279    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="extract"
Sep 10 12:14:40.212326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.212329    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f9f28-4b09-4295-a579-b8a743ceebb6" containerName="extract"
Sep 10 12:14:40.215497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.215479    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.239151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.239128    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:14:40.240350 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.240315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8sj\""
Sep 10 12:14:40.240350 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.240327    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:14:40.241991 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.241964    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"]
Sep 10 12:14:40.351850 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.351821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.352002 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.351857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xll84\" (UniqueName: \"kubernetes.io/projected/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-kube-api-access-xll84\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.352002 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.351888    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.452258 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.452232    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.452447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.452267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xll84\" (UniqueName: \"kubernetes.io/projected/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-kube-api-access-xll84\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.452447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.452294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.452722 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.452701    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.452778 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.452722    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.462004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.461961    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xll84\" (UniqueName: \"kubernetes.io/projected/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-kube-api-access-xll84\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.524532 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.524507    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:40.808713 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:40.808684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"]
Sep 10 12:14:40.810502 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:40.810470    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c508e2_5d54_4ac6_94ef_29ad1a6861e0.slice/crio-355247f61e0b8b74af99dc8de66091509093b7ded640eea253923115bff76758 WatchSource:0}: Error finding container 355247f61e0b8b74af99dc8de66091509093b7ded640eea253923115bff76758: Status 404 returned error can't find the container with id 355247f61e0b8b74af99dc8de66091509093b7ded640eea253923115bff76758
Sep 10 12:14:41.514747 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:41.514717    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:41.595072 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:41.595040    2557 generic.go:356] "Generic (PLEG): container finished" podID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerID="149b6feb27dab799325a0eb12a77ba633cb9dc27544515bf720ccb081ad3b46c" exitCode=0
Sep 10 12:14:41.595261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:41.595110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr" event={"ID":"30c508e2-5d54-4ac6-94ef-29ad1a6861e0","Type":"ContainerDied","Data":"149b6feb27dab799325a0eb12a77ba633cb9dc27544515bf720ccb081ad3b46c"}
Sep 10 12:14:41.595261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:41.595170    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr" event={"ID":"30c508e2-5d54-4ac6-94ef-29ad1a6861e0","Type":"ContainerStarted","Data":"355247f61e0b8b74af99dc8de66091509093b7ded640eea253923115bff76758"}
Sep 10 12:14:42.486463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.486378    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"]
Sep 10 12:14:42.489947 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.489932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.494356 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.494337    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 12:14:42.494530 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.494516    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 12:14:42.494617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.494594    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 12:14:42.494678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.494602    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 12:14:42.494678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.494609    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wqs45\""
Sep 10 12:14:42.513557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.513534    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"]
Sep 10 12:14:42.570400 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.570374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25a5466-b58f-4652-af8b-4a368a6ddf05-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.570710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.570407    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d25a5466-b58f-4652-af8b-4a368a6ddf05-manifests\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.570710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.570468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d25a5466-b58f-4652-af8b-4a368a6ddf05-tmp\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.570710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.570546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d25a5466-b58f-4652-af8b-4a368a6ddf05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.570710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.570572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvnd5\" (UniqueName: \"kubernetes.io/projected/d25a5466-b58f-4652-af8b-4a368a6ddf05-kube-api-access-tvnd5\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.601210 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.601184    2557 generic.go:356] "Generic (PLEG): container finished" podID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerID="9220bcc6e141ed528b0cd3e4bc073444744fc519a90c84676c1c0b3f2ef07e53" exitCode=0
Sep 10 12:14:42.601288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.601215    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr" event={"ID":"30c508e2-5d54-4ac6-94ef-29ad1a6861e0","Type":"ContainerDied","Data":"9220bcc6e141ed528b0cd3e4bc073444744fc519a90c84676c1c0b3f2ef07e53"}
Sep 10 12:14:42.671531 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.671505    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25a5466-b58f-4652-af8b-4a368a6ddf05-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.671639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.671545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d25a5466-b58f-4652-af8b-4a368a6ddf05-manifests\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.671639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.671598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d25a5466-b58f-4652-af8b-4a368a6ddf05-tmp\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.671800 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.671662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d25a5466-b58f-4652-af8b-4a368a6ddf05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.671800 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.671688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvnd5\" (UniqueName: \"kubernetes.io/projected/d25a5466-b58f-4652-af8b-4a368a6ddf05-kube-api-access-tvnd5\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.671945 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.671918    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d25a5466-b58f-4652-af8b-4a368a6ddf05-manifests\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.673904 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.673879    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d25a5466-b58f-4652-af8b-4a368a6ddf05-tmp\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.674102 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.674079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d25a5466-b58f-4652-af8b-4a368a6ddf05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.674160 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.674114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25a5466-b58f-4652-af8b-4a368a6ddf05-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.692515 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.692487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvnd5\" (UniqueName: \"kubernetes.io/projected/d25a5466-b58f-4652-af8b-4a368a6ddf05-kube-api-access-tvnd5\") pod \"opendatahub-operator-controller-manager-5f75798bc7-rjs2s\" (UID: \"d25a5466-b58f-4652-af8b-4a368a6ddf05\") " pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:42.799011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:42.798985    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:43.087230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:43.087140    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"]
Sep 10 12:14:43.091728 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:14:43.091702    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25a5466_b58f_4652_af8b_4a368a6ddf05.slice/crio-71dc8652588150ec1b18bf679d9721a177042b7e5a1c514d8aec042da0cb7e4b WatchSource:0}: Error finding container 71dc8652588150ec1b18bf679d9721a177042b7e5a1c514d8aec042da0cb7e4b: Status 404 returned error can't find the container with id 71dc8652588150ec1b18bf679d9721a177042b7e5a1c514d8aec042da0cb7e4b
Sep 10 12:14:43.444321 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:43.444289    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:43.607420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:43.607390    2557 generic.go:356] "Generic (PLEG): container finished" podID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerID="0b81426b2dc5376c9d54f9295202662493b3058ed96056161d2374ed8688ef2c" exitCode=0
Sep 10 12:14:43.607788 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:43.607485    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr" event={"ID":"30c508e2-5d54-4ac6-94ef-29ad1a6861e0","Type":"ContainerDied","Data":"0b81426b2dc5376c9d54f9295202662493b3058ed96056161d2374ed8688ef2c"}
Sep 10 12:14:43.608670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:43.608649    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s" event={"ID":"d25a5466-b58f-4652-af8b-4a368a6ddf05","Type":"ContainerStarted","Data":"71dc8652588150ec1b18bf679d9721a177042b7e5a1c514d8aec042da0cb7e4b"}
Sep 10 12:14:44.002548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:44.002501    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:44.107914 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:44.107875    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:45.991458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:45.991401    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:46.101967 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.101947    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-util\") pod \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") "
Sep 10 12:14:46.102070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.101988    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xll84\" (UniqueName: \"kubernetes.io/projected/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-kube-api-access-xll84\") pod \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") "
Sep 10 12:14:46.102070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.102023    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-bundle\") pod \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\" (UID: \"30c508e2-5d54-4ac6-94ef-29ad1a6861e0\") "
Sep 10 12:14:46.102738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.102713    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-bundle" (OuterVolumeSpecName: "bundle") pod "30c508e2-5d54-4ac6-94ef-29ad1a6861e0" (UID: "30c508e2-5d54-4ac6-94ef-29ad1a6861e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:14:46.103815 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.103794    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-kube-api-access-xll84" (OuterVolumeSpecName: "kube-api-access-xll84") pod "30c508e2-5d54-4ac6-94ef-29ad1a6861e0" (UID: "30c508e2-5d54-4ac6-94ef-29ad1a6861e0"). InnerVolumeSpecName "kube-api-access-xll84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:14:46.106832 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.106813    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-util" (OuterVolumeSpecName: "util") pod "30c508e2-5d54-4ac6-94ef-29ad1a6861e0" (UID: "30c508e2-5d54-4ac6-94ef-29ad1a6861e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:14:46.202879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.202857    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:46.202879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.202878    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xll84\" (UniqueName: \"kubernetes.io/projected/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-kube-api-access-xll84\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:46.203005 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.202887    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c508e2-5d54-4ac6-94ef-29ad1a6861e0-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:14:46.314206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.314153    2557 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 12:14:46.626414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.626392    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr"
Sep 10 12:14:46.626605 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.626380    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0knmmr" event={"ID":"30c508e2-5d54-4ac6-94ef-29ad1a6861e0","Type":"ContainerDied","Data":"355247f61e0b8b74af99dc8de66091509093b7ded640eea253923115bff76758"}
Sep 10 12:14:46.626605 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.626479    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="355247f61e0b8b74af99dc8de66091509093b7ded640eea253923115bff76758"
Sep 10 12:14:46.628105 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:46.628080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s" event={"ID":"d25a5466-b58f-4652-af8b-4a368a6ddf05","Type":"ContainerStarted","Data":"94a5a7ed60eb0b1c51dc893e06598d1017fc58efdcb9645bf210785b34af54ca"}
Sep 10 12:14:47.634226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:47.634196    2557 generic.go:356] "Generic (PLEG): container finished" podID="d25a5466-b58f-4652-af8b-4a368a6ddf05" containerID="94a5a7ed60eb0b1c51dc893e06598d1017fc58efdcb9645bf210785b34af54ca" exitCode=0
Sep 10 12:14:47.634598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:47.634281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s" event={"ID":"d25a5466-b58f-4652-af8b-4a368a6ddf05","Type":"ContainerDied","Data":"94a5a7ed60eb0b1c51dc893e06598d1017fc58efdcb9645bf210785b34af54ca"}
Sep 10 12:14:47.634702 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:47.634687    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:14:48.640647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:48.640611    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s" event={"ID":"d25a5466-b58f-4652-af8b-4a368a6ddf05","Type":"ContainerStarted","Data":"6a0e0e8e3e09f5fa7e74ed5acd79d9733e65e6b4e36310bb20bc810ad0ddcdb9"}
Sep 10 12:14:48.640996 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:48.640704    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:48.671144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:48.668285    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s" podStartSLOduration=2.409294896 podStartE2EDuration="6.668268242s" totalImagesPullingTime="3.264200971s" totalInitContainerRuntime="994.772375ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:48.664985211 +0000 UTC m=+302.759165398" watchObservedRunningTime="2026-09-10 12:14:48.668268242 +0000 UTC m=+302.762448433"
Sep 10 12:14:53.895751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:53.895716    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:53.994287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:53.994257    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:14:59.647207 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.647178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f75798bc7-rjs2s"
Sep 10 12:14:59.790873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.790837    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"]
Sep 10 12:14:59.791198 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791181    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="util"
Sep 10 12:14:59.791280 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791199    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="util"
Sep 10 12:14:59.791280 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791214    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="extract"
Sep 10 12:14:59.791280 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791221    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="extract"
Sep 10 12:14:59.791280 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791249    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="pull"
Sep 10 12:14:59.791280 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791258    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="pull"
Sep 10 12:14:59.791535 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.791330    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c508e2-5d54-4ac6-94ef-29ad1a6861e0" containerName="extract"
Sep 10 12:14:59.800166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.800133    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.802945 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.802920    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 12:14:59.803170 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.803156    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jmg5p\""
Sep 10 12:14:59.803254 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.803236    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 12:14:59.803462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.803443    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"]
Sep 10 12:14:59.803556 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.803537    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 12:14:59.898340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.898280    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb2dde1a-583c-4f20-b5ae-fc974c01463a-metrics-cert\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.898340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.898308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb2dde1a-583c-4f20-b5ae-fc974c01463a-manager-config\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.898340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.898333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2dde1a-583c-4f20-b5ae-fc974c01463a-cert\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.898522 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.898380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnlwv\" (UniqueName: \"kubernetes.io/projected/cb2dde1a-583c-4f20-b5ae-fc974c01463a-kube-api-access-pnlwv\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.999282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.999258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb2dde1a-583c-4f20-b5ae-fc974c01463a-metrics-cert\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.999282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.999284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb2dde1a-583c-4f20-b5ae-fc974c01463a-manager-config\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.999466 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.999302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2dde1a-583c-4f20-b5ae-fc974c01463a-cert\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.999466 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.999323    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnlwv\" (UniqueName: \"kubernetes.io/projected/cb2dde1a-583c-4f20-b5ae-fc974c01463a-kube-api-access-pnlwv\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:14:59.999946 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:14:59.999927    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb2dde1a-583c-4f20-b5ae-fc974c01463a-manager-config\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:00.001706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:00.001683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb2dde1a-583c-4f20-b5ae-fc974c01463a-metrics-cert\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:00.001706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:00.001703    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb2dde1a-583c-4f20-b5ae-fc974c01463a-cert\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:00.007582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:00.007560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnlwv\" (UniqueName: \"kubernetes.io/projected/cb2dde1a-583c-4f20-b5ae-fc974c01463a-kube-api-access-pnlwv\") pod \"lws-controller-manager-74996bc6f6-pq4jl\" (UID: \"cb2dde1a-583c-4f20-b5ae-fc974c01463a\") " pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:00.109845 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:00.109824    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:00.379377 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:00.379354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"]
Sep 10 12:15:00.381397 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:15:00.381368    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2dde1a_583c_4f20_b5ae_fc974c01463a.slice/crio-f5ad51c1f4bc93a2b41cc1fa2208e38d1aa00799c12a01873ead1ac4e733befe WatchSource:0}: Error finding container f5ad51c1f4bc93a2b41cc1fa2208e38d1aa00799c12a01873ead1ac4e733befe: Status 404 returned error can't find the container with id f5ad51c1f4bc93a2b41cc1fa2208e38d1aa00799c12a01873ead1ac4e733befe
Sep 10 12:15:00.694369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:00.694341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl" event={"ID":"cb2dde1a-583c-4f20-b5ae-fc974c01463a","Type":"ContainerStarted","Data":"f5ad51c1f4bc93a2b41cc1fa2208e38d1aa00799c12a01873ead1ac4e733befe"}
Sep 10 12:15:01.368682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:01.368643    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:01.551265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:01.551227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:01.871996 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:01.871966    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:02.459684 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:02.459647    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:02.712497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:02.712400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl" event={"ID":"cb2dde1a-583c-4f20-b5ae-fc974c01463a","Type":"ContainerStarted","Data":"4af0297bf81dfc83c443be39aac23e23f6491acb78b06d760c1efde2331cc9ab"}
Sep 10 12:15:02.712642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:02.712534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:02.735437 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:02.735379    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl" podStartSLOduration=2.242177408 podStartE2EDuration="3.735360864s" totalImagesPullingTime="1.493183456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:02.733885506 +0000 UTC m=+316.828065697" watchObservedRunningTime="2026-09-10 12:15:02.735360864 +0000 UTC m=+316.829541055"
Sep 10 12:15:03.610075 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:03.610037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:03.713620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:03.713589    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:04.358351 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:04.358323    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:08.168046 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.168016    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:08.265812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.265785    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:08.427043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.426964    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"]
Sep 10 12:15:08.431230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.431207    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.434638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.434617    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 12:15:08.434762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.434676    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 12:15:08.434762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.434700    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vxfrl\""
Sep 10 12:15:08.434959 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.434943    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 12:15:08.444167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.444149    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"]
Sep 10 12:15:08.453918 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.453899    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:08.568733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.568833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.568833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.568919 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.568919 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568873    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c38646-687f-4634-8eed-9b208e95ede0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.568919 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.569026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.569026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97w8w\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-kube-api-access-97w8w\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.569026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.568977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c38646-687f-4634-8eed-9b208e95ede0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.582576 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.582553    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"]
Sep 10 12:15:08.584878 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.584863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.599499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.599469    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"]
Sep 10 12:15:08.670177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670308 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c38646-687f-4634-8eed-9b208e95ede0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670308 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670308 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670239    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670308 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97w8w\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-kube-api-access-97w8w\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670308 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c38646-687f-4634-8eed-9b208e95ede0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670308 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670295    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670768 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670768 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670704    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670892 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.670962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.670944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c38646-687f-4634-8eed-9b208e95ede0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.672510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.672483    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.672651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.672630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c38646-687f-4634-8eed-9b208e95ede0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.680802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.680759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.681037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.681018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97w8w\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-kube-api-access-97w8w\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcc82bp\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.741342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.741315    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:08.767630 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.767594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:08.771729 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8051cce7-d888-4a67-8776-f08533a002ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771827 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771827 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771827 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlg5b\" (UniqueName: \"kubernetes.io/projected/8051cce7-d888-4a67-8776-f08533a002ff-kube-api-access-mlg5b\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771827 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771956 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771956 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.771956 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8051cce7-d888-4a67-8776-f08533a002ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.772042 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.771970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8051cce7-d888-4a67-8776-f08533a002ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.872924 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.872893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.872924 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.872926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.872949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlg5b\" (UniqueName: \"kubernetes.io/projected/8051cce7-d888-4a67-8776-f08533a002ff-kube-api-access-mlg5b\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.872968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8051cce7-d888-4a67-8776-f08533a002ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8051cce7-d888-4a67-8776-f08533a002ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8051cce7-d888-4a67-8776-f08533a002ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873481 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873481 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873360    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873602    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.873896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.873873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8051cce7-d888-4a67-8776-f08533a002ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.875440 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.875409    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8051cce7-d888-4a67-8776-f08533a002ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.875507 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.875435    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8051cce7-d888-4a67-8776-f08533a002ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.884676 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.884646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8051cce7-d888-4a67-8776-f08533a002ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.890551 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.890531    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlg5b\" (UniqueName: \"kubernetes.io/projected/8051cce7-d888-4a67-8776-f08533a002ff-kube-api-access-mlg5b\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m\" (UID: \"8051cce7-d888-4a67-8776-f08533a002ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:08.893357 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:08.893344    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:09.044853 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:15:09.044824    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c38646_687f_4634_8eed_9b208e95ede0.slice/crio-e250ffed7e1091e542819362ad7ffe1549da00ab7f4603ed480b8a217e9f57f9 WatchSource:0}: Error finding container e250ffed7e1091e542819362ad7ffe1549da00ab7f4603ed480b8a217e9f57f9: Status 404 returned error can't find the container with id e250ffed7e1091e542819362ad7ffe1549da00ab7f4603ed480b8a217e9f57f9
Sep 10 12:15:09.051021 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:09.050999    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"]
Sep 10 12:15:09.077610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:09.077587    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:09.175651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:09.175628    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"]
Sep 10 12:15:09.176177 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:15:09.176157    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051cce7_d888_4a67_8776_f08533a002ff.slice/crio-0179fb68bc0597f4d4d457a4718bd5f0204d1d3be2fec2b9657d00ab388ca507 WatchSource:0}: Error finding container 0179fb68bc0597f4d4d457a4718bd5f0204d1d3be2fec2b9657d00ab388ca507: Status 404 returned error can't find the container with id 0179fb68bc0597f4d4d457a4718bd5f0204d1d3be2fec2b9657d00ab388ca507
Sep 10 12:15:09.744172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:09.744137    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m" event={"ID":"8051cce7-d888-4a67-8776-f08533a002ff","Type":"ContainerStarted","Data":"0179fb68bc0597f4d4d457a4718bd5f0204d1d3be2fec2b9657d00ab388ca507"}
Sep 10 12:15:09.745236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:09.745207    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" event={"ID":"90c38646-687f-4634-8eed-9b208e95ede0","Type":"ContainerStarted","Data":"e250ffed7e1091e542819362ad7ffe1549da00ab7f4603ed480b8a217e9f57f9"}
Sep 10 12:15:12.072627 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.072583    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:12.073014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.072676    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:12.073014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.072721    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:12.078659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.078635    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:12.078718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.078694    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:12.078750 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.078722    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:12.259435 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.259394    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xm26t"]
Sep 10 12:15:12.262900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.262874    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.266086 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.266063    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 12:15:12.266647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.266630    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fk658\""
Sep 10 12:15:12.278608 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.278583    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xm26t"]
Sep 10 12:15:12.318939 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.318855    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:12.406277 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.406241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/703d1f18-1d2c-4324-a62c-c85e1f65218b-cert\") pod \"odh-model-controller-7998c67dc4-xm26t\" (UID: \"703d1f18-1d2c-4324-a62c-c85e1f65218b\") " pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.406448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.406288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4lck\" (UniqueName: \"kubernetes.io/projected/703d1f18-1d2c-4324-a62c-c85e1f65218b-kube-api-access-g4lck\") pod \"odh-model-controller-7998c67dc4-xm26t\" (UID: \"703d1f18-1d2c-4324-a62c-c85e1f65218b\") " pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.419873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.419847    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:12.507380 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.507350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4lck\" (UniqueName: \"kubernetes.io/projected/703d1f18-1d2c-4324-a62c-c85e1f65218b-kube-api-access-g4lck\") pod \"odh-model-controller-7998c67dc4-xm26t\" (UID: \"703d1f18-1d2c-4324-a62c-c85e1f65218b\") " pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.508003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.507835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/703d1f18-1d2c-4324-a62c-c85e1f65218b-cert\") pod \"odh-model-controller-7998c67dc4-xm26t\" (UID: \"703d1f18-1d2c-4324-a62c-c85e1f65218b\") " pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.510326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.510296    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/703d1f18-1d2c-4324-a62c-c85e1f65218b-cert\") pod \"odh-model-controller-7998c67dc4-xm26t\" (UID: \"703d1f18-1d2c-4324-a62c-c85e1f65218b\") " pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.517936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.517914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4lck\" (UniqueName: \"kubernetes.io/projected/703d1f18-1d2c-4324-a62c-c85e1f65218b-kube-api-access-g4lck\") pod \"odh-model-controller-7998c67dc4-xm26t\" (UID: \"703d1f18-1d2c-4324-a62c-c85e1f65218b\") " pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.541941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.541922    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:12.574223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.574174    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:12.763408 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.763321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m" event={"ID":"8051cce7-d888-4a67-8776-f08533a002ff","Type":"ContainerStarted","Data":"7b5eee610521f43f563e4a6e8daf8576216cc00dfaab9caa64540e34b3a27341"}
Sep 10 12:15:12.765221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.765181    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" event={"ID":"90c38646-687f-4634-8eed-9b208e95ede0","Type":"ContainerStarted","Data":"cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a"}
Sep 10 12:15:12.786476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.786443    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cvknj"]
Sep 10 12:15:12.788873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.788832    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m" podStartSLOduration=1.888473466 podStartE2EDuration="4.788819349s" totalImagesPullingTime="2.900345883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:12.787154905 +0000 UTC m=+326.881335097" watchObservedRunningTime="2026-09-10 12:15:12.788819349 +0000 UTC m=+326.882999539"
Sep 10 12:15:12.790930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.790912    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:12.794638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.794616    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 12:15:12.805835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.805813    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cvknj"]
Sep 10 12:15:12.824481 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.824395    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" podStartSLOduration=1.798657268 podStartE2EDuration="4.824382829s" totalImagesPullingTime="3.025725561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:12.823064898 +0000 UTC m=+326.917245089" watchObservedRunningTime="2026-09-10 12:15:12.824382829 +0000 UTC m=+326.918563019"
Sep 10 12:15:12.834421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.834366    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:12.846412 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.846390    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xm26t"]
Sep 10 12:15:12.849274 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:15:12.849254    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703d1f18_1d2c_4324_a62c_c85e1f65218b.slice/crio-281beb691fafd2ce52a45b10c17bf7c29e00239928574e30eb8a687843ae838e WatchSource:0}: Error finding container 281beb691fafd2ce52a45b10c17bf7c29e00239928574e30eb8a687843ae838e: Status 404 returned error can't find the container with id 281beb691fafd2ce52a45b10c17bf7c29e00239928574e30eb8a687843ae838e
Sep 10 12:15:12.894438 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.894406    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:12.911892 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.911864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97nnp\" (UniqueName: \"kubernetes.io/projected/5e35f824-2444-4854-acde-0ce12b7bda19-kube-api-access-97nnp\") pod \"model-serving-api-54d89bd5fc-cvknj\" (UID: \"5e35f824-2444-4854-acde-0ce12b7bda19\") " pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:12.911962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.911907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35f824-2444-4854-acde-0ce12b7bda19-tls-certs\") pod \"model-serving-api-54d89bd5fc-cvknj\" (UID: \"5e35f824-2444-4854-acde-0ce12b7bda19\") " pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:12.988478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:12.988419    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:13.012672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.012639    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97nnp\" (UniqueName: \"kubernetes.io/projected/5e35f824-2444-4854-acde-0ce12b7bda19-kube-api-access-97nnp\") pod \"model-serving-api-54d89bd5fc-cvknj\" (UID: \"5e35f824-2444-4854-acde-0ce12b7bda19\") " pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:13.012807 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.012677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35f824-2444-4854-acde-0ce12b7bda19-tls-certs\") pod \"model-serving-api-54d89bd5fc-cvknj\" (UID: \"5e35f824-2444-4854-acde-0ce12b7bda19\") " pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:13.014989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.014966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e35f824-2444-4854-acde-0ce12b7bda19-tls-certs\") pod \"model-serving-api-54d89bd5fc-cvknj\" (UID: \"5e35f824-2444-4854-acde-0ce12b7bda19\") " pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:13.020757 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.020736    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97nnp\" (UniqueName: \"kubernetes.io/projected/5e35f824-2444-4854-acde-0ce12b7bda19-kube-api-access-97nnp\") pod \"model-serving-api-54d89bd5fc-cvknj\" (UID: \"5e35f824-2444-4854-acde-0ce12b7bda19\") " pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:13.101700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.101628    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:13.375230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.375207    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cvknj"]
Sep 10 12:15:13.377479 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:15:13.377452    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e35f824_2444_4854_acde_0ce12b7bda19.slice/crio-d7ee7db651ef98386f26df2ff52afb0de65bfc0d9699ce8211f08ea05ea42d8a WatchSource:0}: Error finding container d7ee7db651ef98386f26df2ff52afb0de65bfc0d9699ce8211f08ea05ea42d8a: Status 404 returned error can't find the container with id d7ee7db651ef98386f26df2ff52afb0de65bfc0d9699ce8211f08ea05ea42d8a
Sep 10 12:15:13.719344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.719265    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74996bc6f6-pq4jl"
Sep 10 12:15:13.742410 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.742384    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:13.743665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.743625    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 10 12:15:13.743784 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.743695    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 10 12:15:13.774256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.774220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj" event={"ID":"5e35f824-2444-4854-acde-0ce12b7bda19","Type":"ContainerStarted","Data":"d7ee7db651ef98386f26df2ff52afb0de65bfc0d9699ce8211f08ea05ea42d8a"}
Sep 10 12:15:13.776380 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.776353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t" event={"ID":"703d1f18-1d2c-4324-a62c-c85e1f65218b","Type":"ContainerStarted","Data":"281beb691fafd2ce52a45b10c17bf7c29e00239928574e30eb8a687843ae838e"}
Sep 10 12:15:13.899670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:13.899636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:14.741892 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:14.741856    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 10 12:15:14.742334 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:14.741919    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 10 12:15:14.782326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:14.782295    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:14.783414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:14.783383    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m"
Sep 10 12:15:14.882266 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:14.882235    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"]
Sep 10 12:15:15.741754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:15.741724    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 10 12:15:15.741930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:15.741791    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 10 12:15:15.787250 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:15.787211    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy" containerID="cri-o://cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a" gracePeriod=30
Sep 10 12:15:17.801309 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:17.801271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj" event={"ID":"5e35f824-2444-4854-acde-0ce12b7bda19","Type":"ContainerStarted","Data":"8d464180bee53a86e643069cf453fb10829e4aae7d023e385dfef572eb41707d"}
Sep 10 12:15:17.801724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:17.801365    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:17.802887 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:17.802861    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t" event={"ID":"703d1f18-1d2c-4324-a62c-c85e1f65218b","Type":"ContainerStarted","Data":"86d429554bb16b3bc80dd3b499a147f13440a68005f29dfaa218a3fbcfc73606"}
Sep 10 12:15:17.803007 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:17.802931    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:17.838471 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:17.838403    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj" podStartSLOduration=2.295836638 podStartE2EDuration="5.838390893s" totalImagesPullingTime="3.542554255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:17.83807947 +0000 UTC m=+331.932259658" watchObservedRunningTime="2026-09-10 12:15:17.838390893 +0000 UTC m=+331.932571086"
Sep 10 12:15:17.872392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:17.872349    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t" podStartSLOduration=1.8388008519999999 podStartE2EDuration="5.872336744s" totalImagesPullingTime="4.033535892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:17.87175716 +0000 UTC m=+331.965937352" watchObservedRunningTime="2026-09-10 12:15:17.872336744 +0000 UTC m=+331.966516937"
Sep 10 12:15:19.942839 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.942807    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"]
Sep 10 12:15:19.949715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.949698    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.953769 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.953745    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 12:15:19.955206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.955182    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 12:15:19.959976 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.959958    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 12:15:19.963772 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.963756    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jvtqq\""
Sep 10 12:15:19.975556 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.975651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pr5\" (UniqueName: \"kubernetes.io/projected/6e733980-623a-4c4e-bbe2-f72e3d9568e7-kube-api-access-w2pr5\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.975651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e733980-623a-4c4e-bbe2-f72e3d9568e7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.975651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.975802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.975863 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.975989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.975954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:19.984354 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:19.984333    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"]
Sep 10 12:15:20.076740 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076705    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.076740 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.076941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pr5\" (UniqueName: \"kubernetes.io/projected/6e733980-623a-4c4e-bbe2-f72e3d9568e7-kube-api-access-w2pr5\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.076941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e733980-623a-4c4e-bbe2-f72e3d9568e7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.076941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.076941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.076941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.076854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.077766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.077738    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.079410 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.079386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e733980-623a-4c4e-bbe2-f72e3d9568e7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.079514 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.079463    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.079565 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.079544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.079802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.079781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.087949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.087928    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e733980-623a-4c4e-bbe2-f72e3d9568e7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.088359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.088340    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pr5\" (UniqueName: \"kubernetes.io/projected/6e733980-623a-4c4e-bbe2-f72e3d9568e7-kube-api-access-w2pr5\") pod \"istiod-openshift-gateway-5677ccb49b-lwrx8\" (UID: \"6e733980-623a-4c4e-bbe2-f72e3d9568e7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.260209 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.260150    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:20.613871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.613845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"]
Sep 10 12:15:20.616643 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:15:20.616615    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e733980_623a_4c4e_bbe2_f72e3d9568e7.slice/crio-c3526186fad38d18bde4f2aa87529ec3f4757dc24c483b24dc03aeb9b22dc93e WatchSource:0}: Error finding container c3526186fad38d18bde4f2aa87529ec3f4757dc24c483b24dc03aeb9b22dc93e: Status 404 returned error can't find the container with id c3526186fad38d18bde4f2aa87529ec3f4757dc24c483b24dc03aeb9b22dc93e
Sep 10 12:15:20.818223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:20.818195    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8" event={"ID":"6e733980-623a-4c4e-bbe2-f72e3d9568e7","Type":"ContainerStarted","Data":"c3526186fad38d18bde4f2aa87529ec3f4757dc24c483b24dc03aeb9b22dc93e"}
Sep 10 12:15:21.029304 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.029281    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:21.086608 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086583    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-envoy\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086623    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-credential-socket\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086651    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-data\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086676    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-socket\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086720    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97w8w\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-kube-api-access-97w8w\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086775    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c38646-687f-4634-8eed-9b208e95ede0-istio-podinfo\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086808    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-istio-token\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086848    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-certs\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.086930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086852    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:15:21.086930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.086893    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c38646-687f-4634-8eed-9b208e95ede0-istiod-ca-cert\") pod \"90c38646-687f-4634-8eed-9b208e95ede0\" (UID: \"90c38646-687f-4634-8eed-9b208e95ede0\") "
Sep 10 12:15:21.087197 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.087128    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-data" (OuterVolumeSpecName: "istio-data") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:15:21.087197 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.087172    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.087298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.087260    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:15:21.087476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.087403    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:15:21.088454 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.088405    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c38646-687f-4634-8eed-9b208e95ede0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:15:21.089534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.089488    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-kube-api-access-97w8w" (OuterVolumeSpecName: "kube-api-access-97w8w") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "kube-api-access-97w8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:15:21.089633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.089590    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90c38646-687f-4634-8eed-9b208e95ede0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:15:21.089709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.089687    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:15:21.089859 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.089844    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-istio-token" (OuterVolumeSpecName: "istio-token") pod "90c38646-687f-4634-8eed-9b208e95ede0" (UID: "90c38646-687f-4634-8eed-9b208e95ede0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:15:21.188043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.187993    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97w8w\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-kube-api-access-97w8w\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188012    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90c38646-687f-4634-8eed-9b208e95ede0-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188021    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90c38646-687f-4634-8eed-9b208e95ede0-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188031    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188039    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90c38646-687f-4634-8eed-9b208e95ede0-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188046    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188262 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188053    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.188262 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.188060    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90c38646-687f-4634-8eed-9b208e95ede0-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:15:21.825929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.825892    2557 generic.go:356] "Generic (PLEG): container finished" podID="90c38646-687f-4634-8eed-9b208e95ede0" containerID="cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a" exitCode=0
Sep 10 12:15:21.826096 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.825934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" event={"ID":"90c38646-687f-4634-8eed-9b208e95ede0","Type":"ContainerDied","Data":"cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a"}
Sep 10 12:15:21.826096 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.825953    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"
Sep 10 12:15:21.826096 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.825987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp" event={"ID":"90c38646-687f-4634-8eed-9b208e95ede0","Type":"ContainerDied","Data":"e250ffed7e1091e542819362ad7ffe1549da00ab7f4603ed480b8a217e9f57f9"}
Sep 10 12:15:21.826096 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.826009    2557 scope.go:117] "RemoveContainer" containerID="cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a"
Sep 10 12:15:21.837065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.837048    2557 scope.go:117] "RemoveContainer" containerID="cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a"
Sep 10 12:15:21.837369 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:15:21.837342    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a\": container with ID starting with cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a not found: ID does not exist" containerID="cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a"
Sep 10 12:15:21.837481 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.837375    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a"} err="failed to get container status \"cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a\": rpc error: code = NotFound desc = could not find container \"cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a\": container with ID starting with cb3734f60946130c1718c70f433feed6763bd5781e9a959a762942ede77c190a not found: ID does not exist"
Sep 10 12:15:21.860839 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.860814    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"]
Sep 10 12:15:21.862824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:21.862806    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp"]
Sep 10 12:15:22.390467 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:22.390407    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c38646-687f-4634-8eed-9b208e95ede0" path="/var/lib/kubelet/pods/90c38646-687f-4634-8eed-9b208e95ede0/volumes"
Sep 10 12:15:23.149578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:23.149547    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:23.149651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:23.149610    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:15:23.839540 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:23.839504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8" event={"ID":"6e733980-623a-4c4e-bbe2-f72e3d9568e7","Type":"ContainerStarted","Data":"25e6e82185945410bee1619b96dc1f83397152619e01e3dbf5a8e178f48b5b93"}
Sep 10 12:15:23.839981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:23.839633    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:23.916762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:23.916696    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8" podStartSLOduration=2.387052732 podStartE2EDuration="4.916676055s" totalImagesPullingTime="2.529623323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:23.915250585 +0000 UTC m=+338.009430776" watchObservedRunningTime="2026-09-10 12:15:23.916676055 +0000 UTC m=+338.010856247"
Sep 10 12:15:24.364644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:24.364617    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:24.712483 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:24.712390    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:24.845612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:24.845579    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8"
Sep 10 12:15:24.924202 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:24.924175    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:25.068623 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:25.068550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:26.039301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:26.039255    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:26.217349 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:26.217323    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:28.809842 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:28.809808    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xm26t"
Sep 10 12:15:28.811857 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:28.811836    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cvknj"
Sep 10 12:15:46.955103 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:46.955071    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:47.059657 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:47.059630    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:57.547972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:57.547937    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6949896564-lggcb"]
Sep 10 12:15:57.686454 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:57.686394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:57.786218 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:57.786173    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:15:57.849101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:15:57.849040    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:13.389947 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:13.389899    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:13.489412 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:13.489382    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:15.341940 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:15.341902    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:15.401169 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:15.401137    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:17.099342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.099309    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:17.205087 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.205058    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:17.459405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.459371    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"]
Sep 10 12:16:17.459734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.459721    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy"
Sep 10 12:16:17.459776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.459735    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy"
Sep 10 12:16:17.459809 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.459801    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c38646-687f-4634-8eed-9b208e95ede0" containerName="istio-proxy"
Sep 10 12:16:17.463938 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.463918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.466563 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.466544    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8sj\""
Sep 10 12:16:17.466656 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.466563    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 12:16:17.467480 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.467467    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 12:16:17.473019 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.472997    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"]
Sep 10 12:16:17.551835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.551801    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"]
Sep 10 12:16:17.555253 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.555231    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.566242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.566219    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"]
Sep 10 12:16:17.616474 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.616445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.616597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.616501    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjk8\" (UniqueName: \"kubernetes.io/projected/3d0dd4b7-40a5-4127-b95e-32cec87dc217-kube-api-access-pzjk8\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.616597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.616549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.650171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.650151    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"]
Sep 10 12:16:17.653596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.653582    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.663942 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.663922    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"]
Sep 10 12:16:17.717972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.717912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.717972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.717951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjk8\" (UniqueName: \"kubernetes.io/projected/3d0dd4b7-40a5-4127-b95e-32cec87dc217-kube-api-access-pzjk8\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.718107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.717987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.718107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.718023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.718107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.718061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9bjq\" (UniqueName: \"kubernetes.io/projected/8a520882-0457-4cc2-a28a-da9b968db123-kube-api-access-n9bjq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.718107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.718090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.718330 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.718309    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.718365 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.718330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.728928 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.728901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjk8\" (UniqueName: \"kubernetes.io/projected/3d0dd4b7-40a5-4127-b95e-32cec87dc217-kube-api-access-pzjk8\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.748442 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.748398    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"]
Sep 10 12:16:17.751970 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.751952    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:17.763024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.763004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"]
Sep 10 12:16:17.773671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.773646    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.819502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69w7p\" (UniqueName: \"kubernetes.io/projected/51444747-03d6-46fe-8443-38651b148f9a-kube-api-access-69w7p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.819624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.819656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.819703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9bjq\" (UniqueName: \"kubernetes.io/projected/8a520882-0457-4cc2-a28a-da9b968db123-kube-api-access-n9bjq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.819740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.819784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.820075    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.820145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.820119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.829173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.829148    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9bjq\" (UniqueName: \"kubernetes.io/projected/8a520882-0457-4cc2-a28a-da9b968db123-kube-api-access-n9bjq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.863855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.863828    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:17.920990 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.920964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69w7p\" (UniqueName: \"kubernetes.io/projected/51444747-03d6-46fe-8443-38651b148f9a-kube-api-access-69w7p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.921091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:17.921166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:17.921263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921184    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.921263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921250    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6n67\" (UniqueName: \"kubernetes.io/projected/9996195a-3650-4ff5-92c3-e29c25072414-kube-api-access-n6n67\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:17.921386 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.921586 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.921706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.921686    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.929721 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.929701    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69w7p\" (UniqueName: \"kubernetes.io/projected/51444747-03d6-46fe-8443-38651b148f9a-kube-api-access-69w7p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:17.962629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:17.962607    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:18.021990 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.021951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6n67\" (UniqueName: \"kubernetes.io/projected/9996195a-3650-4ff5-92c3-e29c25072414-kube-api-access-n6n67\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.022270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.022025    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.022270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.022070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.022499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.022474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.022499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.022492    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.031915 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.031891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6n67\" (UniqueName: \"kubernetes.io/projected/9996195a-3650-4ff5-92c3-e29c25072414-kube-api-access-n6n67\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.044278 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.044259    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"]
Sep 10 12:16:18.046682 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:16:18.046659    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0dd4b7_40a5_4127_b95e_32cec87dc217.slice/crio-ca3ed83ca32f9a86ca29de0f0724ff92cdd1d0a6c4335f95ea10a998e920c1e5 WatchSource:0}: Error finding container ca3ed83ca32f9a86ca29de0f0724ff92cdd1d0a6c4335f95ea10a998e920c1e5: Status 404 returned error can't find the container with id ca3ed83ca32f9a86ca29de0f0724ff92cdd1d0a6c4335f95ea10a998e920c1e5
Sep 10 12:16:18.061166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.061146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:18.100711 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.100683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm" event={"ID":"3d0dd4b7-40a5-4127-b95e-32cec87dc217","Type":"ContainerStarted","Data":"ca3ed83ca32f9a86ca29de0f0724ff92cdd1d0a6c4335f95ea10a998e920c1e5"}
Sep 10 12:16:18.138584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.138255    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"]
Sep 10 12:16:18.140156 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:16:18.140131    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a520882_0457_4cc2_a28a_da9b968db123.slice/crio-390b3bc2f81839356df9323a9b5abb6c6211253b56bae4738f7ce5a9cc32d359 WatchSource:0}: Error finding container 390b3bc2f81839356df9323a9b5abb6c6211253b56bae4738f7ce5a9cc32d359: Status 404 returned error can't find the container with id 390b3bc2f81839356df9323a9b5abb6c6211253b56bae4738f7ce5a9cc32d359
Sep 10 12:16:18.233330 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.233304    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"]
Sep 10 12:16:18.247849 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:16:18.247819    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51444747_03d6_46fe_8443_38651b148f9a.slice/crio-952da255f6b404b6095e996441225ff8a72c3f2e7350ad4b6a1ffb4885bbb3cd WatchSource:0}: Error finding container 952da255f6b404b6095e996441225ff8a72c3f2e7350ad4b6a1ffb4885bbb3cd: Status 404 returned error can't find the container with id 952da255f6b404b6095e996441225ff8a72c3f2e7350ad4b6a1ffb4885bbb3cd
Sep 10 12:16:18.337186 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:18.337162    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"]
Sep 10 12:16:18.384255 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:16:18.384226    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9996195a_3650_4ff5_92c3_e29c25072414.slice/crio-30ffbf3ea60ff3dad58ef278e600e7fc53b8c64db9645ec60530fa1c760facbf WatchSource:0}: Error finding container 30ffbf3ea60ff3dad58ef278e600e7fc53b8c64db9645ec60530fa1c760facbf: Status 404 returned error can't find the container with id 30ffbf3ea60ff3dad58ef278e600e7fc53b8c64db9645ec60530fa1c760facbf
Sep 10 12:16:19.107612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.107580    2557 generic.go:356] "Generic (PLEG): container finished" podID="9996195a-3650-4ff5-92c3-e29c25072414" containerID="22810ca286e36df70c306b028e181fff545897a9882c836790bac72ed60756c9" exitCode=0
Sep 10 12:16:19.108122 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.107666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh" event={"ID":"9996195a-3650-4ff5-92c3-e29c25072414","Type":"ContainerDied","Data":"22810ca286e36df70c306b028e181fff545897a9882c836790bac72ed60756c9"}
Sep 10 12:16:19.108122 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.107714    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh" event={"ID":"9996195a-3650-4ff5-92c3-e29c25072414","Type":"ContainerStarted","Data":"30ffbf3ea60ff3dad58ef278e600e7fc53b8c64db9645ec60530fa1c760facbf"}
Sep 10 12:16:19.109324 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.109302    2557 generic.go:356] "Generic (PLEG): container finished" podID="51444747-03d6-46fe-8443-38651b148f9a" containerID="ea84f15bf12c2cc4e1f8ec5483853269a8790b9a75acfa82e4cdd873afca4b80" exitCode=0
Sep 10 12:16:19.109416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.109325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn" event={"ID":"51444747-03d6-46fe-8443-38651b148f9a","Type":"ContainerDied","Data":"ea84f15bf12c2cc4e1f8ec5483853269a8790b9a75acfa82e4cdd873afca4b80"}
Sep 10 12:16:19.109416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.109364    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn" event={"ID":"51444747-03d6-46fe-8443-38651b148f9a","Type":"ContainerStarted","Data":"952da255f6b404b6095e996441225ff8a72c3f2e7350ad4b6a1ffb4885bbb3cd"}
Sep 10 12:16:19.110853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.110830    2557 generic.go:356] "Generic (PLEG): container finished" podID="8a520882-0457-4cc2-a28a-da9b968db123" containerID="0f4f31944468bf9328ea217b547cb002b4d40a022a7bc5e56af8e5a7f5902b59" exitCode=0
Sep 10 12:16:19.110925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.110913    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl" event={"ID":"8a520882-0457-4cc2-a28a-da9b968db123","Type":"ContainerDied","Data":"0f4f31944468bf9328ea217b547cb002b4d40a022a7bc5e56af8e5a7f5902b59"}
Sep 10 12:16:19.110974 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.110956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl" event={"ID":"8a520882-0457-4cc2-a28a-da9b968db123","Type":"ContainerStarted","Data":"390b3bc2f81839356df9323a9b5abb6c6211253b56bae4738f7ce5a9cc32d359"}
Sep 10 12:16:19.112573 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.112554    2557 generic.go:356] "Generic (PLEG): container finished" podID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerID="dce20b59d3381fbd3efb5e89d8fb18f599ba40f12faf3dd5136b42525da94b7e" exitCode=0
Sep 10 12:16:19.112666 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:19.112582    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm" event={"ID":"3d0dd4b7-40a5-4127-b95e-32cec87dc217","Type":"ContainerDied","Data":"dce20b59d3381fbd3efb5e89d8fb18f599ba40f12faf3dd5136b42525da94b7e"}
Sep 10 12:16:20.119552 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:20.119525    2557 generic.go:356] "Generic (PLEG): container finished" podID="51444747-03d6-46fe-8443-38651b148f9a" containerID="002e569d4b95570f6e636d76d1e43a7cd58a1cd3b906e0d772648d2251bd824a" exitCode=0
Sep 10 12:16:20.119835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:20.119571    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn" event={"ID":"51444747-03d6-46fe-8443-38651b148f9a","Type":"ContainerDied","Data":"002e569d4b95570f6e636d76d1e43a7cd58a1cd3b906e0d772648d2251bd824a"}
Sep 10 12:16:21.126589 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:21.126555    2557 generic.go:356] "Generic (PLEG): container finished" podID="9996195a-3650-4ff5-92c3-e29c25072414" containerID="3f0d9ec1926c3fcc6c9995c7518b16de5719b10d01adec34497d07184c378561" exitCode=0
Sep 10 12:16:21.126960 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:21.126639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh" event={"ID":"9996195a-3650-4ff5-92c3-e29c25072414","Type":"ContainerDied","Data":"3f0d9ec1926c3fcc6c9995c7518b16de5719b10d01adec34497d07184c378561"}
Sep 10 12:16:21.128828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:21.128804    2557 generic.go:356] "Generic (PLEG): container finished" podID="51444747-03d6-46fe-8443-38651b148f9a" containerID="d75652d71c334692305ddc688a15d3775302352d0ba40873bc70c4b84df43d52" exitCode=0
Sep 10 12:16:21.128916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:21.128894    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn" event={"ID":"51444747-03d6-46fe-8443-38651b148f9a","Type":"ContainerDied","Data":"d75652d71c334692305ddc688a15d3775302352d0ba40873bc70c4b84df43d52"}
Sep 10 12:16:22.135015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.134984    2557 generic.go:356] "Generic (PLEG): container finished" podID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerID="6441a4952ee8b68f0fcd35797603bc5798859aaa4e6c9cc69dd020afe4ba8140" exitCode=0
Sep 10 12:16:22.135470 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.135070    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm" event={"ID":"3d0dd4b7-40a5-4127-b95e-32cec87dc217","Type":"ContainerDied","Data":"6441a4952ee8b68f0fcd35797603bc5798859aaa4e6c9cc69dd020afe4ba8140"}
Sep 10 12:16:22.137298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.137276    2557 generic.go:356] "Generic (PLEG): container finished" podID="9996195a-3650-4ff5-92c3-e29c25072414" containerID="88c0b61bedcbbeaf8373b02f22492acdd292825fbe6d41fe985bb4c007246c4b" exitCode=0
Sep 10 12:16:22.137402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.137355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh" event={"ID":"9996195a-3650-4ff5-92c3-e29c25072414","Type":"ContainerDied","Data":"88c0b61bedcbbeaf8373b02f22492acdd292825fbe6d41fe985bb4c007246c4b"}
Sep 10 12:16:22.263995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.263973    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:22.356736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.356710    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69w7p\" (UniqueName: \"kubernetes.io/projected/51444747-03d6-46fe-8443-38651b148f9a-kube-api-access-69w7p\") pod \"51444747-03d6-46fe-8443-38651b148f9a\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") "
Sep 10 12:16:22.356862 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.356747    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-bundle\") pod \"51444747-03d6-46fe-8443-38651b148f9a\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") "
Sep 10 12:16:22.356862 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.356781    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-util\") pod \"51444747-03d6-46fe-8443-38651b148f9a\" (UID: \"51444747-03d6-46fe-8443-38651b148f9a\") "
Sep 10 12:16:22.357392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.357364    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-bundle" (OuterVolumeSpecName: "bundle") pod "51444747-03d6-46fe-8443-38651b148f9a" (UID: "51444747-03d6-46fe-8443-38651b148f9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:22.358646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.358622    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51444747-03d6-46fe-8443-38651b148f9a-kube-api-access-69w7p" (OuterVolumeSpecName: "kube-api-access-69w7p") pod "51444747-03d6-46fe-8443-38651b148f9a" (UID: "51444747-03d6-46fe-8443-38651b148f9a"). InnerVolumeSpecName "kube-api-access-69w7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:16:22.364557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.364533    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-util" (OuterVolumeSpecName: "util") pod "51444747-03d6-46fe-8443-38651b148f9a" (UID: "51444747-03d6-46fe-8443-38651b148f9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:22.457730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.457707    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:22.457730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.457729    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69w7p\" (UniqueName: \"kubernetes.io/projected/51444747-03d6-46fe-8443-38651b148f9a-kube-api-access-69w7p\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:22.457854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.457739    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51444747-03d6-46fe-8443-38651b148f9a-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:22.567146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.567118    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6949896564-lggcb" podUID="fa1cae3d-9cf4-4702-ba56-24f080096e55" containerName="console" containerID="cri-o://e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9" gracePeriod=15
Sep 10 12:16:22.793761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.793733    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:16:22.960989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.960919    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-service-ca\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.960989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.960948    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-serving-cert\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.961190 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.960994    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8f6d\" (UniqueName: \"kubernetes.io/projected/fa1cae3d-9cf4-4702-ba56-24f080096e55-kube-api-access-h8f6d\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.961190 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961061    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-config\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.961190 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961077    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-oauth-config\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.961339 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961274    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-oauth-serving-cert\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.961339 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961317    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-trusted-ca-bundle\") pod \"fa1cae3d-9cf4-4702-ba56-24f080096e55\" (UID: \"fa1cae3d-9cf4-4702-ba56-24f080096e55\") "
Sep 10 12:16:22.961457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961349    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:16:22.961521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961418    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-config" (OuterVolumeSpecName: "console-config") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:16:22.961654 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961633    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:22.961723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961648    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:16:22.961723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961657    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:22.961868 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.961846    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:16:22.963160 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.963142    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:16:22.963553 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.963536    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 12:16:22.963597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:22.963563    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1cae3d-9cf4-4702-ba56-24f080096e55-kube-api-access-h8f6d" (OuterVolumeSpecName: "kube-api-access-h8f6d") pod "fa1cae3d-9cf4-4702-ba56-24f080096e55" (UID: "fa1cae3d-9cf4-4702-ba56-24f080096e55"). InnerVolumeSpecName "kube-api-access-h8f6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:16:23.062682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.062663    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.062682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.062681    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.062793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.062690    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa1cae3d-9cf4-4702-ba56-24f080096e55-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.062793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.062699    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1cae3d-9cf4-4702-ba56-24f080096e55-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.062793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.062708    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8f6d\" (UniqueName: \"kubernetes.io/projected/fa1cae3d-9cf4-4702-ba56-24f080096e55-kube-api-access-h8f6d\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.144419 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.144398    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn"
Sep 10 12:16:23.144802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.144448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atlsbn" event={"ID":"51444747-03d6-46fe-8443-38651b148f9a","Type":"ContainerDied","Data":"952da255f6b404b6095e996441225ff8a72c3f2e7350ad4b6a1ffb4885bbb3cd"}
Sep 10 12:16:23.144802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.144492    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="952da255f6b404b6095e996441225ff8a72c3f2e7350ad4b6a1ffb4885bbb3cd"
Sep 10 12:16:23.146653 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.146633    2557 generic.go:356] "Generic (PLEG): container finished" podID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerID="acf510734aef49549030931ef221c59b2519648c0d5c685d0da5ce5e9fc0a4d2" exitCode=0
Sep 10 12:16:23.146749 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.146706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm" event={"ID":"3d0dd4b7-40a5-4127-b95e-32cec87dc217","Type":"ContainerDied","Data":"acf510734aef49549030931ef221c59b2519648c0d5c685d0da5ce5e9fc0a4d2"}
Sep 10 12:16:23.147985 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.147962    2557 generic.go:356] "Generic (PLEG): container finished" podID="fa1cae3d-9cf4-4702-ba56-24f080096e55" containerID="e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9" exitCode=0
Sep 10 12:16:23.148074 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.147995    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6949896564-lggcb"
Sep 10 12:16:23.148074 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.148030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6949896564-lggcb" event={"ID":"fa1cae3d-9cf4-4702-ba56-24f080096e55","Type":"ContainerDied","Data":"e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9"}
Sep 10 12:16:23.148074 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.148065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6949896564-lggcb" event={"ID":"fa1cae3d-9cf4-4702-ba56-24f080096e55","Type":"ContainerDied","Data":"f82616fa8a318bc66300b1f157a4614bb03b86a5876174e19c773167d3580fbc"}
Sep 10 12:16:23.148163 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.148090    2557 scope.go:117] "RemoveContainer" containerID="e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9"
Sep 10 12:16:23.163584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.163558    2557 scope.go:117] "RemoveContainer" containerID="e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9"
Sep 10 12:16:23.163897 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:16:23.163880    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9\": container with ID starting with e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9 not found: ID does not exist" containerID="e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9"
Sep 10 12:16:23.163951 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.163904    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9"} err="failed to get container status \"e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9\": rpc error: code = NotFound desc = could not find container \"e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9\": container with ID starting with e33f5f1afe2bfd07f6e9a529c5e3bc62ed2ae28b6a9a273e5c04a4e93484e4e9 not found: ID does not exist"
Sep 10 12:16:23.181069 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.181019    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6949896564-lggcb"]
Sep 10 12:16:23.186339 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.186313    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6949896564-lggcb"]
Sep 10 12:16:23.302872 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.302846    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:23.465640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.465617    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-util\") pod \"9996195a-3650-4ff5-92c3-e29c25072414\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") "
Sep 10 12:16:23.465779 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.465648    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6n67\" (UniqueName: \"kubernetes.io/projected/9996195a-3650-4ff5-92c3-e29c25072414-kube-api-access-n6n67\") pod \"9996195a-3650-4ff5-92c3-e29c25072414\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") "
Sep 10 12:16:23.465779 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.465702    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-bundle\") pod \"9996195a-3650-4ff5-92c3-e29c25072414\" (UID: \"9996195a-3650-4ff5-92c3-e29c25072414\") "
Sep 10 12:16:23.466219 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.466188    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-bundle" (OuterVolumeSpecName: "bundle") pod "9996195a-3650-4ff5-92c3-e29c25072414" (UID: "9996195a-3650-4ff5-92c3-e29c25072414"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:23.467900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.467873    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9996195a-3650-4ff5-92c3-e29c25072414-kube-api-access-n6n67" (OuterVolumeSpecName: "kube-api-access-n6n67") pod "9996195a-3650-4ff5-92c3-e29c25072414" (UID: "9996195a-3650-4ff5-92c3-e29c25072414"). InnerVolumeSpecName "kube-api-access-n6n67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:16:23.470978 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.470959    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-util" (OuterVolumeSpecName: "util") pod "9996195a-3650-4ff5-92c3-e29c25072414" (UID: "9996195a-3650-4ff5-92c3-e29c25072414"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:23.566841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.566782    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.566841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.566808    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6n67\" (UniqueName: \"kubernetes.io/projected/9996195a-3650-4ff5-92c3-e29c25072414-kube-api-access-n6n67\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:23.566841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:23.566822    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9996195a-3650-4ff5-92c3-e29c25072414-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:24.154937 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.154913    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh"
Sep 10 12:16:24.155320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.154941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xj9lh" event={"ID":"9996195a-3650-4ff5-92c3-e29c25072414","Type":"ContainerDied","Data":"30ffbf3ea60ff3dad58ef278e600e7fc53b8c64db9645ec60530fa1c760facbf"}
Sep 10 12:16:24.155320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.154980    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30ffbf3ea60ff3dad58ef278e600e7fc53b8c64db9645ec60530fa1c760facbf"
Sep 10 12:16:24.273143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.273125    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:24.373453 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.373412    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-util\") pod \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") "
Sep 10 12:16:24.373591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.373515    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzjk8\" (UniqueName: \"kubernetes.io/projected/3d0dd4b7-40a5-4127-b95e-32cec87dc217-kube-api-access-pzjk8\") pod \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") "
Sep 10 12:16:24.373591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.373554    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-bundle\") pod \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\" (UID: \"3d0dd4b7-40a5-4127-b95e-32cec87dc217\") "
Sep 10 12:16:24.374023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.374000    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-bundle" (OuterVolumeSpecName: "bundle") pod "3d0dd4b7-40a5-4127-b95e-32cec87dc217" (UID: "3d0dd4b7-40a5-4127-b95e-32cec87dc217"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:24.375639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.375615    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0dd4b7-40a5-4127-b95e-32cec87dc217-kube-api-access-pzjk8" (OuterVolumeSpecName: "kube-api-access-pzjk8") pod "3d0dd4b7-40a5-4127-b95e-32cec87dc217" (UID: "3d0dd4b7-40a5-4127-b95e-32cec87dc217"). InnerVolumeSpecName "kube-api-access-pzjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:16:24.378453 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.378420    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-util" (OuterVolumeSpecName: "util") pod "3d0dd4b7-40a5-4127-b95e-32cec87dc217" (UID: "3d0dd4b7-40a5-4127-b95e-32cec87dc217"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:24.389569 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.389545    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa1cae3d-9cf4-4702-ba56-24f080096e55" path="/var/lib/kubelet/pods/fa1cae3d-9cf4-4702-ba56-24f080096e55/volumes"
Sep 10 12:16:24.474758 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.474710    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:24.474758 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.474727    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzjk8\" (UniqueName: \"kubernetes.io/projected/3d0dd4b7-40a5-4127-b95e-32cec87dc217-kube-api-access-pzjk8\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:24.474758 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:24.474736    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d0dd4b7-40a5-4127-b95e-32cec87dc217-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:25.162057 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:25.162031    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm"
Sep 10 12:16:25.162378 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:25.162025    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7kcrcm" event={"ID":"3d0dd4b7-40a5-4127-b95e-32cec87dc217","Type":"ContainerDied","Data":"ca3ed83ca32f9a86ca29de0f0724ff92cdd1d0a6c4335f95ea10a998e920c1e5"}
Sep 10 12:16:25.162378 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:25.162151    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca3ed83ca32f9a86ca29de0f0724ff92cdd1d0a6c4335f95ea10a998e920c1e5"
Sep 10 12:16:42.246485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:42.246453    2557 generic.go:356] "Generic (PLEG): container finished" podID="8a520882-0457-4cc2-a28a-da9b968db123" containerID="1d48aee4b537403b659162282db64039caf8758064b172d95b22541ca0953950" exitCode=0
Sep 10 12:16:42.246818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:42.246539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl" event={"ID":"8a520882-0457-4cc2-a28a-da9b968db123","Type":"ContainerDied","Data":"1d48aee4b537403b659162282db64039caf8758064b172d95b22541ca0953950"}
Sep 10 12:16:43.253321 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:43.253289    2557 generic.go:356] "Generic (PLEG): container finished" podID="8a520882-0457-4cc2-a28a-da9b968db123" containerID="b6fa70672c0c24a16e8df2b71b4d5ce15d5a4ef85f25838c6badd8b87aa23d5f" exitCode=0
Sep 10 12:16:43.253705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:43.253351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl" event={"ID":"8a520882-0457-4cc2-a28a-da9b968db123","Type":"ContainerDied","Data":"b6fa70672c0c24a16e8df2b71b4d5ce15d5a4ef85f25838c6badd8b87aa23d5f"}
Sep 10 12:16:44.376783 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.376761    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:44.409053 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.409029    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-bundle\") pod \"8a520882-0457-4cc2-a28a-da9b968db123\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") "
Sep 10 12:16:44.409181 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.409075    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-util\") pod \"8a520882-0457-4cc2-a28a-da9b968db123\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") "
Sep 10 12:16:44.409181 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.409168    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9bjq\" (UniqueName: \"kubernetes.io/projected/8a520882-0457-4cc2-a28a-da9b968db123-kube-api-access-n9bjq\") pod \"8a520882-0457-4cc2-a28a-da9b968db123\" (UID: \"8a520882-0457-4cc2-a28a-da9b968db123\") "
Sep 10 12:16:44.409696 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.409657    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-bundle" (OuterVolumeSpecName: "bundle") pod "8a520882-0457-4cc2-a28a-da9b968db123" (UID: "8a520882-0457-4cc2-a28a-da9b968db123"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:44.411259 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.411237    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a520882-0457-4cc2-a28a-da9b968db123-kube-api-access-n9bjq" (OuterVolumeSpecName: "kube-api-access-n9bjq") pod "8a520882-0457-4cc2-a28a-da9b968db123" (UID: "8a520882-0457-4cc2-a28a-da9b968db123"). InnerVolumeSpecName "kube-api-access-n9bjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:16:44.413570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.413544    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-util" (OuterVolumeSpecName: "util") pod "8a520882-0457-4cc2-a28a-da9b968db123" (UID: "8a520882-0457-4cc2-a28a-da9b968db123"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:16:44.510194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.510127    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9bjq\" (UniqueName: \"kubernetes.io/projected/8a520882-0457-4cc2-a28a-da9b968db123-kube-api-access-n9bjq\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:44.510194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.510151    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:44.510194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:44.510163    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a520882-0457-4cc2-a28a-da9b968db123-util\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:16:45.264414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:45.264387    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl"
Sep 10 12:16:45.264568 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:45.264412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckjcrl" event={"ID":"8a520882-0457-4cc2-a28a-da9b968db123","Type":"ContainerDied","Data":"390b3bc2f81839356df9323a9b5abb6c6211253b56bae4738f7ce5a9cc32d359"}
Sep 10 12:16:45.264568 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:45.264474    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="390b3bc2f81839356df9323a9b5abb6c6211253b56bae4738f7ce5a9cc32d359"
Sep 10 12:16:53.416981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:53.416937    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:54.224182 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:54.224151    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:57.445892 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:57.445863    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:57.765356 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:57.765258    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:57.989625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:57.989594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:16:58.461599 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:16:58.461566    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:00.153727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:00.153696    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:01.815546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:01.815500    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:02.079387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:02.079300    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:04.037025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:04.036978    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:05.936578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:05.936543    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:06.838148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:06.838111    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:06.938511 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:06.938480    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:07.224900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:07.224875    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:07.325704 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:07.325679    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:07.961862 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:07.961830    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:08.364001 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:08.363972    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:11.621502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:11.621470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:11.722518 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:11.722488    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:12.028822 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:12.028747    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:12.128673 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:12.128642    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:12.275596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:12.275550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:12.402974 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:12.402930    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:18.270366 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:18.270330    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:18.377633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:18.377603    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:21.760084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:21.760050    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:22.722225 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:22.722191    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:22.852342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:22.852297    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:26.634505 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:26.634467    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:26.894591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:26.894510    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:27.104458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:27.104405    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:30.400118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:30.400074    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:30.517272 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:30.517241    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:30.608291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:30.608260    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:36.890695 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:36.890655    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:36.951986 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:36.951959    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:41.642367 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:41.642338    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:41.743891 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:41.743858    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:45.450871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:45.450832    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:45.794500 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:45.794381    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:46.038671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:46.038642    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:46.139810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:46.139786    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:49.287761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.287729    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"]
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288078    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="util"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288092    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="util"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288102    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="util"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288107    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="util"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288117    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa1cae3d-9cf4-4702-ba56-24f080096e55" containerName="console"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288123    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa1cae3d-9cf4-4702-ba56-24f080096e55" containerName="console"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288135    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="pull"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288142    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="pull"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288148    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="pull"
Sep 10 12:17:49.288152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288153    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="pull"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288160    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288165    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288171    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288176    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288184    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288189    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288194    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="pull"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288198    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="pull"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288204    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="pull"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288208    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="pull"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288215    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288221    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288228    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="util"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288234    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="util"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288239    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="util"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288244    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="util"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288295    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a520882-0457-4cc2-a28a-da9b968db123" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288302    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0dd4b7-40a5-4127-b95e-32cec87dc217" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288307    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa1cae3d-9cf4-4702-ba56-24f080096e55" containerName="console"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288315    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="51444747-03d6-46fe-8443-38651b148f9a" containerName="extract"
Sep 10 12:17:49.288502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.288320    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9996195a-3650-4ff5-92c3-e29c25072414" containerName="extract"
Sep 10 12:17:49.291263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.291246    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.294031 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.294015    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rl8b9\""
Sep 10 12:17:49.305376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.305354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"]
Sep 10 12:17:49.386498 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/58d8d628-de27-4af9-82dd-4aca34bc3666-kube-api-access-qng5p\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386521    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58d8d628-de27-4af9-82dd-4aca34bc3666-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386658    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386740    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.386824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.387036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.386829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.421963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.421939    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:49.488158 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/58d8d628-de27-4af9-82dd-4aca34bc3666-kube-api-access-qng5p\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58d8d628-de27-4af9-82dd-4aca34bc3666-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488392    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488566    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488714    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.488936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.488917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58d8d628-de27-4af9-82dd-4aca34bc3666-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.490522 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.490502    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.490835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.490814    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.500301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.500278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng5p\" (UniqueName: \"kubernetes.io/projected/58d8d628-de27-4af9-82dd-4aca34bc3666-kube-api-access-qng5p\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.500609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.500590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58d8d628-de27-4af9-82dd-4aca34bc3666-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6t8xw\" (UID: \"58d8d628-de27-4af9-82dd-4aca34bc3666\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.600693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.600637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:49.876349 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.876322    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"]
Sep 10 12:17:49.878025 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:17:49.877997    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d8d628_de27_4af9_82dd_4aca34bc3666.slice/crio-a5c76fe61bab72c77b6d4ed6199820d7921f2cea86181f54f4fb391b75d1e450 WatchSource:0}: Error finding container a5c76fe61bab72c77b6d4ed6199820d7921f2cea86181f54f4fb391b75d1e450: Status 404 returned error can't find the container with id a5c76fe61bab72c77b6d4ed6199820d7921f2cea86181f54f4fb391b75d1e450
Sep 10 12:17:49.880116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.880087    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:17:49.880168 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.880148    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:17:49.880206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.880174    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:17:49.889661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:49.889632    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:50.578551 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.578520    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" event={"ID":"58d8d628-de27-4af9-82dd-4aca34bc3666","Type":"ContainerStarted","Data":"292163cf48a78f12771a9c5694b5a6e3f5369b60916421790dc81197acbe3ee0"}
Sep 10 12:17:50.578893 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.578580    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" event={"ID":"58d8d628-de27-4af9-82dd-4aca34bc3666","Type":"ContainerStarted","Data":"a5c76fe61bab72c77b6d4ed6199820d7921f2cea86181f54f4fb391b75d1e450"}
Sep 10 12:17:50.601007 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.600980    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:50.602064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.602017    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" podStartSLOduration=1.6019991930000002 podStartE2EDuration="1.601999193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:17:50.60196521 +0000 UTC m=+484.696145403" watchObservedRunningTime="2026-09-10 12:17:50.601999193 +0000 UTC m=+484.696179385"
Sep 10 12:17:50.605974 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.605956    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:50.651121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.651094    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:50.723694 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:50.723664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:51.046575 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.046519    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:51.122385 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.122349    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:51.460027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.459987    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:51.563006 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.562981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:51.583506 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.583482    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:51.584404 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.584384    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:17:51.664710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.664675    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:51.761051 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:51.760979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:52.498949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:52.498915    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:52.599928 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:52.599884    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:56.796881 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:56.796831    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:17:56.871148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:17:56.871094    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:01.547550 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:01.547514    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:01.645763 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:01.645718    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:07.632228 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:07.632193    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:07.725987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:07.725956    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:08.081816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:08.081747    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:19.514506 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:19.514475    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:19.734300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:19.734250    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:25.976646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:25.976614    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:26.079753 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:26.079721    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:26.175708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:26.175669    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:26.258538 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:26.258464    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:29.407726 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:29.407689    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:29.505738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:29.505711    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:59.340913 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:59.340842    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:18:59.427610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:18:59.427581    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:00.904817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:00.904739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:00.984696 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:00.984663    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:01.193761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:01.193674    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:01.338959 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:01.338931    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:01.440294 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:01.440266    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:01.521521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:01.521411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:10.978395 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:10.978349    2557 generic.go:356] "Generic (PLEG): container finished" podID="58d8d628-de27-4af9-82dd-4aca34bc3666" containerID="292163cf48a78f12771a9c5694b5a6e3f5369b60916421790dc81197acbe3ee0" exitCode=0
Sep 10 12:19:10.978816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:10.978421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" event={"ID":"58d8d628-de27-4af9-82dd-4aca34bc3666","Type":"ContainerDied","Data":"292163cf48a78f12771a9c5694b5a6e3f5369b60916421790dc81197acbe3ee0"}
Sep 10 12:19:10.978816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:10.978809    2557 scope.go:117] "RemoveContainer" containerID="292163cf48a78f12771a9c5694b5a6e3f5369b60916421790dc81197acbe3ee0"
Sep 10 12:19:10.979751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:10.979726    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:19:10.979844 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:10.979793    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:19:10.979844 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:10.979825    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:19:11.222538 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:11.222505    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:11.985875 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:11.985843    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" event={"ID":"58d8d628-de27-4af9-82dd-4aca34bc3666","Type":"ContainerStarted","Data":"d4bb6e6efab808a928442328eb4478fe4380577c8a470615ba934162447c1e41"}
Sep 10 12:19:12.601444 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:12.601396    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:19:12.601610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:12.601579    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6t8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:19:12.601659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:12.601623    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" podUID="58d8d628-de27-4af9-82dd-4aca34bc3666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 10 12:19:13.432201 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:13.432171    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:13.534465 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:13.534263    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:13.601637 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:13.601607    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6t8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:19:13.601796 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:13.601657    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" podUID="58d8d628-de27-4af9-82dd-4aca34bc3666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 10 12:19:14.601729 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:14.601700    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6t8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:19:14.602084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:14.601761    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" podUID="58d8d628-de27-4af9-82dd-4aca34bc3666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 10 12:19:15.601681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:15.601644    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6t8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:19:15.601848 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:15.601694    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" podUID="58d8d628-de27-4af9-82dd-4aca34bc3666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 10 12:19:15.931014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:15.930981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:16.601597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:16.601564    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6t8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 10 12:19:16.601762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:16.601618    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw" podUID="58d8d628-de27-4af9-82dd-4aca34bc3666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 10 12:19:17.605029 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:17.605003    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:19:17.605458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:17.605251    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:19:17.605998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:17.605981    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw"
Sep 10 12:19:23.358631 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.358587    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"]
Sep 10 12:19:23.361518 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.361492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.364333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.364313    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 12:19:23.364452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.364352    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 12:19:23.365253 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.365232    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x8ww2\""
Sep 10 12:19:23.365253 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.365247    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 12:19:23.372023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.372004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"]
Sep 10 12:19:23.395302 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.395282    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:23.519715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.519685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.519845 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.519761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhj4h\" (UniqueName: \"kubernetes.io/projected/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-kube-api-access-bhj4h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.519845 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.519823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.519958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.519856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.519958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.519926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.520064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.520028    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621418 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621418 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621418 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhj4h\" (UniqueName: \"kubernetes.io/projected/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-kube-api-access-bhj4h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621418 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.621741 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.621670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.623383 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.623364    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.623497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.623481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.629678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.629659    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhj4h\" (UniqueName: \"kubernetes.io/projected/83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab-kube-api-access-bhj4h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z\" (UID: \"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.673396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.673376    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:23.944926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:23.944901    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"]
Sep 10 12:19:23.946131 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:19:23.946102    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83638eb6_1a44_4bd4_b6c8_4e9fd06e80ab.slice/crio-888ec732b83cbf4c680c6ad45450779d5f944d1e052f3fc126783961f09edf1f WatchSource:0}: Error finding container 888ec732b83cbf4c680c6ad45450779d5f944d1e052f3fc126783961f09edf1f: Status 404 returned error can't find the container with id 888ec732b83cbf4c680c6ad45450779d5f944d1e052f3fc126783961f09edf1f
Sep 10 12:19:24.049727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:24.049696    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z" event={"ID":"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab","Type":"ContainerStarted","Data":"888ec732b83cbf4c680c6ad45450779d5f944d1e052f3fc126783961f09edf1f"}
Sep 10 12:19:25.056237 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:25.056204    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z" event={"ID":"83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab","Type":"ContainerStarted","Data":"84491645f9e70395436162bc3d72f84908ece0ca10fbf647f56a7456f674abbc"}
Sep 10 12:19:25.076669 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:25.076625    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z" podStartSLOduration=1.167650379 podStartE2EDuration="2.076610301s" totalImagesPullingTime="908.959922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:19:25.075748844 +0000 UTC m=+579.169929029" watchObservedRunningTime="2026-09-10 12:19:25.076610301 +0000 UTC m=+579.170790490"
Sep 10 12:19:32.552550 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.552514    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"]
Sep 10 12:19:32.555324 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.555302    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.557836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.557817    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 12:19:32.573503 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.573478    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"]
Sep 10 12:19:32.582084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.582063    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:32.693053 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.693026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.693167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.693060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.693167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.693085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.693167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.693142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.693341 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.693218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgvp\" (UniqueName: \"kubernetes.io/projected/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-kube-api-access-7pgvp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.693341 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.693277    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794543 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794696 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgvp\" (UniqueName: \"kubernetes.io/projected/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-kube-api-access-7pgvp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794696 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794696 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794860 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794860 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.794959 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794878    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.795014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.794972    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.795074 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.795026    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.796971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.796949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.797184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.797166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.802534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.802515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgvp\" (UniqueName: \"kubernetes.io/projected/7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459-kube-api-access-7pgvp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f9bm7\" (UID: \"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:32.873393 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:32.873372    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:33.142976 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:33.142947    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"]
Sep 10 12:19:33.144452 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:19:33.144410    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb1d0bc_1274_4b9a_8ac7_8bc5b95d0459.slice/crio-ec19a5d1802b26809ee598990c2dbe79c4a362bd870393b9880fc85d56c91b68 WatchSource:0}: Error finding container ec19a5d1802b26809ee598990c2dbe79c4a362bd870393b9880fc85d56c91b68: Status 404 returned error can't find the container with id ec19a5d1802b26809ee598990c2dbe79c4a362bd870393b9880fc85d56c91b68
Sep 10 12:19:33.673626 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:33.673593    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:33.673990 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:33.673757    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:33.686452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:33.686416    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:34.101754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:34.101665    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7" event={"ID":"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459","Type":"ContainerStarted","Data":"ed29e7b789796b36aeffe15608552355965ef6720c8b3b96c6208936ffbe299c"}
Sep 10 12:19:34.101754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:34.101726    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7" event={"ID":"7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459","Type":"ContainerStarted","Data":"ec19a5d1802b26809ee598990c2dbe79c4a362bd870393b9880fc85d56c91b68"}
Sep 10 12:19:34.112766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:34.112742    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z"
Sep 10 12:19:34.122169 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:34.122128    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7" podStartSLOduration=1.948091292 podStartE2EDuration="2.122114351s" totalImagesPullingTime="174.023059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:19:34.121074677 +0000 UTC m=+588.215254890" watchObservedRunningTime="2026-09-10 12:19:34.122114351 +0000 UTC m=+588.216294540"
Sep 10 12:19:37.567023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:37.566991    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:40.982791 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:40.982756    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:42.874377 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:42.874345    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:42.874764 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:42.874404    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:42.886227 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:42.886205    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:43.155259 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:43.155180    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f9bm7"
Sep 10 12:19:50.156147 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.156114    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"]
Sep 10 12:19:50.158366 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.158346    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.160890 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.160871    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 12:19:50.169590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.169566    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"]
Sep 10 12:19:50.196130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.196106    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:19:50.220527 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.220500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023f5459-d281-48bd-b204-86012ce7e23c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.220610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.220531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.220610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.220568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.220610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.220588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.220745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.220631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.220745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.220660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqt8b\" (UniqueName: \"kubernetes.io/projected/023f5459-d281-48bd-b204-86012ce7e23c-kube-api-access-wqt8b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.321895 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.321870    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023f5459-d281-48bd-b204-86012ce7e23c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.321901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.321933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.321959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.322022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322260 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.322050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqt8b\" (UniqueName: \"kubernetes.io/projected/023f5459-d281-48bd-b204-86012ce7e23c-kube-api-access-wqt8b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322332 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.322310    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322619 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.322599    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.322707 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.322664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.324949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.324922    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/023f5459-d281-48bd-b204-86012ce7e23c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.325202 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.325180    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023f5459-d281-48bd-b204-86012ce7e23c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.333409 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.333320    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqt8b\" (UniqueName: \"kubernetes.io/projected/023f5459-d281-48bd-b204-86012ce7e23c-kube-api-access-wqt8b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zhvc4\" (UID: \"023f5459-d281-48bd-b204-86012ce7e23c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.469630 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.469576    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:19:50.742194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.742163    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"]
Sep 10 12:19:50.743394 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:19:50.743362    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023f5459_d281_48bd_b204_86012ce7e23c.slice/crio-09bdf751cc27ddb57ea7dfcb0e754744df8defab37554050b1adfba2c0b97a6f WatchSource:0}: Error finding container 09bdf751cc27ddb57ea7dfcb0e754744df8defab37554050b1adfba2c0b97a6f: Status 404 returned error can't find the container with id 09bdf751cc27ddb57ea7dfcb0e754744df8defab37554050b1adfba2c0b97a6f
Sep 10 12:19:50.744818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:50.744802    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:19:51.185182 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:51.185154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4" event={"ID":"023f5459-d281-48bd-b204-86012ce7e23c","Type":"ContainerStarted","Data":"3d0c31e618a00e3432e09bb9e441e95afdf5ae1329c4d6bd5a2a023d5a945cb4"}
Sep 10 12:19:51.185659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:51.185201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4" event={"ID":"023f5459-d281-48bd-b204-86012ce7e23c","Type":"ContainerStarted","Data":"09bdf751cc27ddb57ea7dfcb0e754744df8defab37554050b1adfba2c0b97a6f"}
Sep 10 12:19:51.208338 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:19:51.208298    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4" podStartSLOduration=1.019110636 podStartE2EDuration="1.208282263s" totalImagesPullingTime="189.171627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:19:51.206150997 +0000 UTC m=+605.300331189" watchObservedRunningTime="2026-09-10 12:19:51.208282263 +0000 UTC m=+605.302462504"
Sep 10 12:20:00.470238 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:00.470200    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:20:00.470613 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:00.470286    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:20:00.482332 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:00.482311    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:20:01.246159 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:01.246133    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zhvc4"
Sep 10 12:20:04.561387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:04.561339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:20:15.451057 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:15.451006    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:20:15.516231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:15.516205    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:20:17.373130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:17.373088    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:20:29.175027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:29.174994    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:20:59.700557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:59.700526    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:20:59.800022 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:20:59.799991    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:21:32.964536 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:21:32.964502    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:21:33.032952 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:21:33.032926    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:21:55.860542 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:21:55.860461    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:21:55.959084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:21:55.959052    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:21:56.937297 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:21:56.937260    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:21:57.035206 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:21:57.035175    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:12.196571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.196541    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:12.340925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.340896    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:12.531967 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.531885    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"]
Sep 10 12:22:12.534357 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.534334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.541060 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.541043    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7576a1-openshift-default-dockercfg-6px5w\""
Sep 10 12:22:12.567817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.567787    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"]
Sep 10 12:22:12.578033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.578008    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:12.626092 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-envoy\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-credential-socket\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-data\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwsk\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-kube-api-access-4nwsk\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-podinfo\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-token\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-certs\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d817175-1e42-41be-aa71-17fd93e40f1a-istiod-ca-cert\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.626448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.626367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-socket\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727399    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-envoy\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-credential-socket\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-data\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727523    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwsk\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-kube-api-access-4nwsk\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727550    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-podinfo\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-token\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-certs\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d817175-1e42-41be-aa71-17fd93e40f1a-istiod-ca-cert\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-socket\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-data\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.727972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.727944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-credential-socket\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.728191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.728096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-socket\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.728191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.728160    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-certs\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.728698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.728660    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d817175-1e42-41be-aa71-17fd93e40f1a-istiod-ca-cert\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.729929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.729888    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-envoy\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.730256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.730234    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-podinfo\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.743921 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.743896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-token\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.744127 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.744110    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwsk\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-kube-api-access-4nwsk\") pod \"e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") " pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:12.798234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.798167    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:12.844646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:12.844622    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:13.128913 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.128889    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"]
Sep 10 12:22:13.130209 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:22:13.130184    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d817175_1e42_41be_aa71_17fd93e40f1a.slice/crio-64847714f1850d950093444afb096a61195d245810d38275a160ea1d9e1846a0 WatchSource:0}: Error finding container 64847714f1850d950093444afb096a61195d245810d38275a160ea1d9e1846a0: Status 404 returned error can't find the container with id 64847714f1850d950093444afb096a61195d245810d38275a160ea1d9e1846a0
Sep 10 12:22:13.132118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.132090    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:13.132186 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.132150    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:13.132186 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.132175    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:13.575727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.575642    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:13.670342 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.670314    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:13.898820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.898790    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" event={"ID":"3d817175-1e42-41be-aa71-17fd93e40f1a","Type":"ContainerStarted","Data":"0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"}
Sep 10 12:22:13.899021 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.898881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" event={"ID":"3d817175-1e42-41be-aa71-17fd93e40f1a","Type":"ContainerStarted","Data":"64847714f1850d950093444afb096a61195d245810d38275a160ea1d9e1846a0"}
Sep 10 12:22:13.939301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.939249    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podStartSLOduration=1.939235385 podStartE2EDuration="1.939235385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:13.936586246 +0000 UTC m=+748.030766437" watchObservedRunningTime="2026-09-10 12:22:13.939235385 +0000 UTC m=+748.033415576"
Sep 10 12:22:13.970690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:13.970659    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:14.844991 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:14.844959    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:14.849246 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:14.849225    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:14.903877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:14.903847    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:14.904501 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:14.904482    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:15.909826 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:15.909785    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:16.020028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:16.019996    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:17.136937 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:17.136897    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:17.328139 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:17.328107    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:18.264180 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.264150    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:18.355218 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.355186    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"]
Sep 10 12:22:18.358203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.358188    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.362024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.362004    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7576a1\""
Sep 10 12:22:18.363351 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.363332    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7576a1-dockercfg-6gb9j\""
Sep 10 12:22:18.372398 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.372377    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"]
Sep 10 12:22:18.443773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.443741    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:18.481163 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.481126    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31fa993a-1255-488e-90a2-f8e5fe1f251b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.481312 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.481232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9r6z\" (UniqueName: \"kubernetes.io/projected/31fa993a-1255-488e-90a2-f8e5fe1f251b-kube-api-access-f9r6z\") pod \"payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.582479 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.582400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31fa993a-1255-488e-90a2-f8e5fe1f251b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.582606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.582494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9r6z\" (UniqueName: \"kubernetes.io/projected/31fa993a-1255-488e-90a2-f8e5fe1f251b-kube-api-access-f9r6z\") pod \"payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.583077 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.583058    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31fa993a-1255-488e-90a2-f8e5fe1f251b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.599406 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.599368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9r6z\" (UniqueName: \"kubernetes.io/projected/31fa993a-1255-488e-90a2-f8e5fe1f251b-kube-api-access-f9r6z\") pod \"payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.668082 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.668058    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:18.943934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:18.943903    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"]
Sep 10 12:22:18.945660 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:22:18.945638    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fa993a_1255_488e_90a2_f8e5fe1f251b.slice/crio-8027aefc9288f5275e5eab179badc3c1bec33f7eaa8cff21a51b332f18bfd495 WatchSource:0}: Error finding container 8027aefc9288f5275e5eab179badc3c1bec33f7eaa8cff21a51b332f18bfd495: Status 404 returned error can't find the container with id 8027aefc9288f5275e5eab179badc3c1bec33f7eaa8cff21a51b332f18bfd495
Sep 10 12:22:19.933246 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:19.933209    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x" event={"ID":"31fa993a-1255-488e-90a2-f8e5fe1f251b","Type":"ContainerStarted","Data":"8027aefc9288f5275e5eab179badc3c1bec33f7eaa8cff21a51b332f18bfd495"}
Sep 10 12:22:21.548612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:21.548575    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:21.654148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:21.654109    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:21.773899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:21.773866    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:21.945337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:21.945248    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x" event={"ID":"31fa993a-1255-488e-90a2-f8e5fe1f251b","Type":"ContainerStarted","Data":"c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b"}
Sep 10 12:22:21.945709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:21.945686    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:21.983365 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:21.983323    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x" podStartSLOduration=1.628482468 podStartE2EDuration="3.983310292s" totalImagesPullingTime="2.354827824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:21.981185182 +0000 UTC m=+756.075365374" watchObservedRunningTime="2026-09-10 12:22:21.983310292 +0000 UTC m=+756.077490523"
Sep 10 12:22:22.076410 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.076377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:22.135522 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.135496    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"]
Sep 10 12:22:22.138059 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.138045    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.143183 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.143164    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-772cfbbb-openshift-default-dockercfg-slnsn\""
Sep 10 12:22:22.159761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.159744    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"]
Sep 10 12:22:22.205104 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.205045    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:22.216820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.216789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-credential-socket\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.216962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.216856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-certs\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217029 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.216961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-envoy\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217087 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.217059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istiod-ca-cert\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.217106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-data\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.217160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlqbz\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-kube-api-access-qlqbz\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.217189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-podinfo\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.217218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-token\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.217310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.217263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-socket\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317753 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-socket\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317753 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317758    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-credential-socket\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317775    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-certs\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317843    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-envoy\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istiod-ca-cert\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317916    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-data\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlqbz\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-kube-api-access-qlqbz\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.317993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.317986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-podinfo\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.318287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.318009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-token\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.318287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.318170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-credential-socket\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.318478 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.318458    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-socket\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.318552 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.318491    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-certs\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.318636 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.318618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-data\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.318751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.318726    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istiod-ca-cert\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.320508 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.320477    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-envoy\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.320634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.320575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-podinfo\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.329112 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.329091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-token\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.329221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.329124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlqbz\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-kube-api-access-qlqbz\") pod \"e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") " pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.375971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.375947    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"]
Sep 10 12:22:22.379184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.379166    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.382010 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.381993    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-98aa83-openshift-default-dockercfg-xd6sq\""
Sep 10 12:22:22.398835 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.398814    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"]
Sep 10 12:22:22.411181 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.411160    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:22.450497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.450478    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:22.506490 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.506453    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:22.519263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-podinfo\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-credential-socket\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519351    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-token\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519568 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519398    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjrs\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-kube-api-access-dgjrs\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519568 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519521    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-socket\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519673 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-certs\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519673 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e722baa-61e8-45ce-9f93-9b4b7e327576-istiod-ca-cert\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519673 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-envoy\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.519838 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.519704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-data\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620400 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-podinfo\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-credential-socket\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620448    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-token\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620549    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjrs\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-kube-api-access-dgjrs\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-socket\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-certs\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e722baa-61e8-45ce-9f93-9b4b7e327576-istiod-ca-cert\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-envoy\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.620785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-data\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.621175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.620844    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-credential-socket\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.621175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.621063    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-data\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.621175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.621096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-certs\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.621350 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.621328    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-socket\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.621504 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.621488    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e722baa-61e8-45ce-9f93-9b4b7e327576-istiod-ca-cert\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.623254 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.623235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-envoy\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.623369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.623307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-podinfo\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.630028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.629978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-token\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.630408 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.630390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjrs\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-kube-api-access-dgjrs\") pod \"e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") " pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.651795 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.651768    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:22.690084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.690064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:22.748604 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.748565    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"]
Sep 10 12:22:22.754633 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:22:22.754608    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d3074f_0c1b_43c8_81b3_2591a7c37693.slice/crio-0c6f71f302a3edc75d90535a08ce7075e5858a7b7b10edae1cff27d1a9c5bbdf WatchSource:0}: Error finding container 0c6f71f302a3edc75d90535a08ce7075e5858a7b7b10edae1cff27d1a9c5bbdf: Status 404 returned error can't find the container with id 0c6f71f302a3edc75d90535a08ce7075e5858a7b7b10edae1cff27d1a9c5bbdf
Sep 10 12:22:22.757388 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.757358    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:22.757497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.757444    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:22.757497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.757482    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:22.955489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.954920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" event={"ID":"b1d3074f-0c1b-43c8-81b3-2591a7c37693","Type":"ContainerStarted","Data":"b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"}
Sep 10 12:22:22.955489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.954995    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" event={"ID":"b1d3074f-0c1b-43c8-81b3-2591a7c37693","Type":"ContainerStarted","Data":"0c6f71f302a3edc75d90535a08ce7075e5858a7b7b10edae1cff27d1a9c5bbdf"}
Sep 10 12:22:22.974248 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.974197    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"]
Sep 10 12:22:22.983080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.982541    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:22.983080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.982630    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:22.983080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.982678    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:22.985476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:22.985078    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podStartSLOduration=0.985061118 podStartE2EDuration="985.061118ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:22.983317608 +0000 UTC m=+757.077497843" watchObservedRunningTime="2026-09-10 12:22:22.985061118 +0000 UTC m=+757.079241309"
Sep 10 12:22:23.451654 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:23.451367    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:23.453145 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:23.453119    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 12:22:23.453395 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:23.453355    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 12:22:23.971000 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:23.970959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" event={"ID":"9e722baa-61e8-45ce-9f93-9b4b7e327576","Type":"ContainerStarted","Data":"4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"}
Sep 10 12:22:23.971505 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:23.971020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" event={"ID":"9e722baa-61e8-45ce-9f93-9b4b7e327576","Type":"ContainerStarted","Data":"089314f43c616ebf4dd39268e267941a3fb4a8a38526214f9d639cbb20bfda3f"}
Sep 10 12:22:23.997485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:23.997385    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podStartSLOduration=1.9973675960000001 podStartE2EDuration="1.997367596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:23.995786649 +0000 UTC m=+758.089966854" watchObservedRunningTime="2026-09-10 12:22:23.997367596 +0000 UTC m=+758.091547789"
Sep 10 12:22:24.394065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.394010    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:24.464886 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.464851    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:24.501489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.501440    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:24.690547 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.690461    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:24.695248 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.695223    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:24.978270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.978188    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:24.978270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.978236    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:24.979143 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.979124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:24.979205 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:24.979180    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:25.541254 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:25.541218    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:25.669457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:25.669344    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:26.150464 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:26.150415    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:26.275875 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:26.275841    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:26.381727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:26.381688    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:27.442225 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:27.442188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:27.541873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:27.541841    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:28.025628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:28.025599    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:28.239490 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:28.239455    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:28.341192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:28.341116    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:30.945614 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:30.945570    2557 patch_prober.go:28] interesting pod/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 12:22:30.945991 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:30.945654    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 12:22:31.203448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:31.203336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:31.442629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:31.442597    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:31.676956 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:31.676923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:31.805441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:31.805403    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:32.958360 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:32.958331    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:22:33.025374 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:33.025340    2557 generic.go:356] "Generic (PLEG): container finished" podID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerID="0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f" exitCode=0
Sep 10 12:22:33.025582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:33.025394    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" event={"ID":"3d817175-1e42-41be-aa71-17fd93e40f1a","Type":"ContainerDied","Data":"0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"}
Sep 10 12:22:33.025825 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:33.025809    2557 scope.go:117] "RemoveContainer" containerID="0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"
Sep 10 12:22:33.027199 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:33.027166    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:33.027281 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:33.027256    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:33.027319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:33.027307    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:34.035319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:34.035287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" event={"ID":"3d817175-1e42-41be-aa71-17fd93e40f1a","Type":"ContainerStarted","Data":"a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b"}
Sep 10 12:22:34.320635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:34.320534    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:34.845335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:34.845301    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:34.845523 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:34.845503    2557 patch_prober.go:28] interesting pod/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 12:22:34.845572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:34.845548    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 12:22:35.845173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:35.845142    2557 patch_prober.go:28] interesting pod/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 12:22:35.845583 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:35.845537    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 12:22:35.938120 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:35.938091    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:36.769773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:36.768934    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:36.845376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:36.845260    2557 patch_prober.go:28] interesting pod/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 12:22:36.845376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:36.845327    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 12:22:37.845296 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:37.845255    2557 patch_prober.go:28] interesting pod/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 12:22:37.845501 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:37.845327    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 12:22:38.845860 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:38.845817    2557 patch_prober.go:28] interesting pod/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 12:22:38.846307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:38.845909    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 12:22:39.025040 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:39.025002    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:39.858538 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:39.858511    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:39.858901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:39.858805    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:39.859598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:39.859578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:22:39.989149 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:39.987982    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:49380->10.133.0.42:15021: read: connection reset by peer" start-of-body=
Sep 10 12:22:39.989149 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:39.988058    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:49380->10.133.0.42:15021: read: connection reset by peer"
Sep 10 12:22:40.088214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.088185    2557 generic.go:356] "Generic (PLEG): container finished" podID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerID="b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8" exitCode=0
Sep 10 12:22:40.088350 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.088256    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" event={"ID":"b1d3074f-0c1b-43c8-81b3-2591a7c37693","Type":"ContainerDied","Data":"b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"}
Sep 10 12:22:40.088848 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.088831    2557 scope.go:117] "RemoveContainer" containerID="b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"
Sep 10 12:22:40.089896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.089873    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:40.089954 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.089937    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:40.089996 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.089970    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:40.775414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.775378    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:40.880763 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.880728    2557 patch_prober.go:28] interesting pod/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:57278->10.133.0.43:15021: read: connection reset by peer" start-of-body=
Sep 10 12:22:40.881135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:40.880790    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:57278->10.133.0.43:15021: read: connection reset by peer"
Sep 10 12:22:41.090230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.090128    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:41.095659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.095634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" event={"ID":"b1d3074f-0c1b-43c8-81b3-2591a7c37693","Type":"ContainerStarted","Data":"52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea"}
Sep 10 12:22:41.097071 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.097051    2557 generic.go:356] "Generic (PLEG): container finished" podID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerID="4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af" exitCode=0
Sep 10 12:22:41.097222 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.097123    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" event={"ID":"9e722baa-61e8-45ce-9f93-9b4b7e327576","Type":"ContainerDied","Data":"4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"}
Sep 10 12:22:41.097590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.097572    2557 scope.go:117] "RemoveContainer" containerID="4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"
Sep 10 12:22:41.098567 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.098543    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:41.098637 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.098622    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:41.098674 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.098660    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:41.391386 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.391351    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"]
Sep 10 12:22:41.394972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.394944    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.398856 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.398840    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fb35b9-openshift-default-dockercfg-kq2v9\""
Sep 10 12:22:41.411955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.411825    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"]
Sep 10 12:22:41.423371 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.423336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:41.451812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.451747    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:41.452246 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.452224    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 12:22:41.452400 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.452378    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 12:22:41.498781 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-token\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.498781 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-credential-socket\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81994ee7-7267-4ebc-91cf-6588a4b754f7-istiod-ca-cert\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-podinfo\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-certs\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxf4m\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-kube-api-access-dxf4m\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-envoy\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.498970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-data\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.499028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.499025    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-socket\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600247 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-socket\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600269    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-token\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600300    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-credential-socket\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81994ee7-7267-4ebc-91cf-6588a4b754f7-istiod-ca-cert\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-podinfo\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-certs\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxf4m\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-kube-api-access-dxf4m\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-envoy\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-data\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-credential-socket\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.600953 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.600922    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-certs\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.601192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.601169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-data\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.601298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.601169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-socket\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.601298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.601247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81994ee7-7267-4ebc-91cf-6588a4b754f7-istiod-ca-cert\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.603193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.603170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-podinfo\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.603409 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.603392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-envoy\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.610394 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.610371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-token\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.612240 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.612218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxf4m\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-kube-api-access-dxf4m\") pod \"e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") " pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:41.694586 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.694514    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:41.706589 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:41.706567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:42.030166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.030128    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"]
Sep 10 12:22:42.036270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.035953    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:42.036270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.036076    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:42.036270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.036152    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:22:42.108121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.108090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" event={"ID":"9e722baa-61e8-45ce-9f93-9b4b7e327576","Type":"ContainerStarted","Data":"c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1"}
Sep 10 12:22:42.109925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.109896    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" event={"ID":"81994ee7-7267-4ebc-91cf-6588a4b754f7","Type":"ContainerStarted","Data":"204c917627dd9fd054fc0befeb1cc7fceb0f82bd705ef9e4520855021fd2eab2"}
Sep 10 12:22:42.451821 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.451781    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 12:22:42.452578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.452129    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 12:22:42.691333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.690984    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:42.691333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.691017    2557 patch_prober.go:28] interesting pod/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 12:22:42.691333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:42.691058    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 12:22:43.117623 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.117588    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" event={"ID":"81994ee7-7267-4ebc-91cf-6588a4b754f7","Type":"ContainerStarted","Data":"de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"}
Sep 10 12:22:43.148290 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.148231    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podStartSLOduration=2.148200478 podStartE2EDuration="2.148200478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:43.146953206 +0000 UTC m=+777.241133399" watchObservedRunningTime="2026-09-10 12:22:43.148200478 +0000 UTC m=+777.242380670"
Sep 10 12:22:43.451625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.451523    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 12:22:43.451625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.451584    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 12:22:43.690774 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.690730    2557 patch_prober.go:28] interesting pod/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 12:22:43.690974 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.690796    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 12:22:43.707589 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.707509    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:43.711831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:43.711808    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:44.123561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:44.123534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:44.124535 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:44.124516    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:22:44.452032 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:44.451935    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 12:22:44.452214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:44.452072    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 12:22:44.690978 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:44.690937    2557 patch_prober.go:28] interesting pod/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 12:22:44.691175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:44.691016    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 12:22:45.452070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:45.451641    2557 patch_prober.go:28] interesting pod/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 10 12:22:45.452070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:45.451702    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 10 12:22:45.691284 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:45.690850    2557 patch_prober.go:28] interesting pod/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 12:22:45.691284 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:45.690915    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 12:22:46.460743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.460707    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:46.462026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.462004    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:46.462887 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.462868    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:22:46.691026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.690995    2557 patch_prober.go:28] interesting pod/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 10 12:22:46.691204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.691066    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 10 12:22:46.745421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.745337    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:46.857825 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:46.857784    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:47.381495 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.381455    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:47.583831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.583802    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:47.687509 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.687434    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"]
Sep 10 12:22:47.691868 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.691843    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:47.694690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.694672    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:47.694933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.694913    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:47.695591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.695573    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:22:47.697063 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.697043    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-fb35b9-dockercfg-hctfn\""
Sep 10 12:22:47.697155 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.697064    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-fb35b9\""
Sep 10 12:22:47.709727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.709708    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"]
Sep 10 12:22:47.767984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.767948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13502297-dcde-422b-8779-2e3c55bd6986-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:47.768175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.768147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmhpv\" (UniqueName: \"kubernetes.io/projected/13502297-dcde-422b-8779-2e3c55bd6986-kube-api-access-dmhpv\") pod \"payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:47.868724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.868687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13502297-dcde-422b-8779-2e3c55bd6986-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:47.868886 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.868763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmhpv\" (UniqueName: \"kubernetes.io/projected/13502297-dcde-422b-8779-2e3c55bd6986-kube-api-access-dmhpv\") pod \"payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:47.869312 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.869292    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13502297-dcde-422b-8779-2e3c55bd6986-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:47.879727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:47.879699    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmhpv\" (UniqueName: \"kubernetes.io/projected/13502297-dcde-422b-8779-2e3c55bd6986-kube-api-access-dmhpv\") pod \"payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:48.001890 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:48.001834    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:48.007869 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:48.007845    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:48.299592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:48.299567    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"]
Sep 10 12:22:48.301032 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:22:48.301009    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13502297_dcde_422b_8779_2e3c55bd6986.slice/crio-729be0847154877715ed1311056592edcac289358068052ade2d6b6f26406d46 WatchSource:0}: Error finding container 729be0847154877715ed1311056592edcac289358068052ade2d6b6f26406d46: Status 404 returned error can't find the container with id 729be0847154877715ed1311056592edcac289358068052ade2d6b6f26406d46
Sep 10 12:22:48.989445 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:48.989404    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:49.158797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:49.158760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl" event={"ID":"13502297-dcde-422b-8779-2e3c55bd6986","Type":"ContainerStarted","Data":"42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece"}
Sep 10 12:22:49.158970 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:49.158833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl" event={"ID":"13502297-dcde-422b-8779-2e3c55bd6986","Type":"ContainerStarted","Data":"729be0847154877715ed1311056592edcac289358068052ade2d6b6f26406d46"}
Sep 10 12:22:49.158970 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:49.158968    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:22:49.185082 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:49.185037    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl" podStartSLOduration=2.185023171 podStartE2EDuration="2.185023171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:49.182627693 +0000 UTC m=+783.276807885" watchObservedRunningTime="2026-09-10 12:22:49.185023171 +0000 UTC m=+783.279203362"
Sep 10 12:22:50.024138 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:50.024110    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:50.999698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:50.999663    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:52.055159 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:52.055124    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:22:56.029886 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:22:56.029850    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:00.167677 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:00.167639    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:23:04.244208 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:04.244177    2557 generic.go:356] "Generic (PLEG): container finished" podID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerID="de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944" exitCode=0
Sep 10 12:23:04.244685 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:04.244252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" event={"ID":"81994ee7-7267-4ebc-91cf-6588a4b754f7","Type":"ContainerDied","Data":"de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"}
Sep 10 12:23:04.244685 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:04.244630    2557 scope.go:117] "RemoveContainer" containerID="de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"
Sep 10 12:23:04.245709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:04.245684    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:23:04.245786 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:04.245748    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:23:04.245786 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:04.245779    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:23:05.253529 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:05.253490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" event={"ID":"81994ee7-7267-4ebc-91cf-6588a4b754f7","Type":"ContainerStarted","Data":"c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0"}
Sep 10 12:23:05.707590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:05.707563    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:23:05.707821 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:05.707800    2557 patch_prober.go:28] interesting pod/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 12:23:05.707866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:05.707844    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 12:23:05.750707 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:05.750675    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:06.404270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.404236    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:06.485717 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.485676    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:06.570448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.569528    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:06.645511 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.645483    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:06.707326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.707245    2557 patch_prober.go:28] interesting pod/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 12:23:06.707326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.707300    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 12:23:06.719888 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.719862    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:06.797173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.797139    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"]
Sep 10 12:23:06.797456 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.797406    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy" containerID="cri-o://52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea" gracePeriod=30
Sep 10 12:23:06.806940 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:06.806919    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:07.239753 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.239704    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:07.332061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.332023    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:07.445479 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.445446    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:07.706859 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.706823    2557 patch_prober.go:28] interesting pod/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 12:23:07.707041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.706887    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 12:23:07.827061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.827033    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:07.900520 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:07.900480    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:08.087129 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:08.087030    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:08.707620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:08.707585    2557 patch_prober.go:28] interesting pod/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 12:23:08.707987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:08.707651    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 12:23:09.707645 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:09.707611    2557 patch_prober.go:28] interesting pod/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 12:23:09.708019 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:09.707668    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 12:23:09.936912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:09.936865    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:10.710611 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:10.710581    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:23:10.710995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:10.710880    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:23:10.711571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:10.711549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:23:12.035270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.035249    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:23:12.118432 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118405    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istiod-ca-cert\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118472    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-token\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118500    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-data\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118534    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-podinfo\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118560    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-credential-socket\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118646    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-envoy\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118671    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-socket\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118697    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlqbz\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-kube-api-access-qlqbz\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.118797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118723    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-certs\") pod \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\" (UID: \"b1d3074f-0c1b-43c8-81b3-2591a7c37693\") "
Sep 10 12:23:12.119010 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118729    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:23:12.119010 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118827    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:23:12.119010 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.118914    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:23:12.119172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119018    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:23:12.119172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119032    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:23:12.119278 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119187    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.119278 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119204    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.119278 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119212    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.119278 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119221    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.119278 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.119230    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.120824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.120800    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:23:12.120824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.120807    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:23:12.121049 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.121022    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-kube-api-access-qlqbz" (OuterVolumeSpecName: "kube-api-access-qlqbz") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "kube-api-access-qlqbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:23:12.121049 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.121029    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1d3074f-0c1b-43c8-81b3-2591a7c37693" (UID: "b1d3074f-0c1b-43c8-81b3-2591a7c37693"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:23:12.219793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.219769    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.219793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.219790    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.219932 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.219799    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlqbz\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-kube-api-access-qlqbz\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.219932 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.219808    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1d3074f-0c1b-43c8-81b3-2591a7c37693-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:12.301232 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.301209    2557 generic.go:356] "Generic (PLEG): container finished" podID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerID="52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea" exitCode=0
Sep 10 12:23:12.301329 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.301255    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"
Sep 10 12:23:12.301329 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.301292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" event={"ID":"b1d3074f-0c1b-43c8-81b3-2591a7c37693","Type":"ContainerDied","Data":"52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea"}
Sep 10 12:23:12.301401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.301348    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb" event={"ID":"b1d3074f-0c1b-43c8-81b3-2591a7c37693","Type":"ContainerDied","Data":"0c6f71f302a3edc75d90535a08ce7075e5858a7b7b10edae1cff27d1a9c5bbdf"}
Sep 10 12:23:12.301401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.301376    2557 scope.go:117] "RemoveContainer" containerID="52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea"
Sep 10 12:23:12.310992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.310976    2557 scope.go:117] "RemoveContainer" containerID="b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"
Sep 10 12:23:12.318816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.318803    2557 scope.go:117] "RemoveContainer" containerID="52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea"
Sep 10 12:23:12.319048 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:23:12.319030    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea\": container with ID starting with 52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea not found: ID does not exist" containerID="52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea"
Sep 10 12:23:12.319088 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.319056    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea"} err="failed to get container status \"52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea\": rpc error: code = NotFound desc = could not find container \"52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea\": container with ID starting with 52481ed868559efd63339f15157cb6def88b6e819a63c67bf0b65f90bf2062ea not found: ID does not exist"
Sep 10 12:23:12.319088 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.319072    2557 scope.go:117] "RemoveContainer" containerID="b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"
Sep 10 12:23:12.319303 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:23:12.319286    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8\": container with ID starting with b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8 not found: ID does not exist" containerID="b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"
Sep 10 12:23:12.319343 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.319309    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8"} err="failed to get container status \"b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8\": rpc error: code = NotFound desc = could not find container \"b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8\": container with ID starting with b46f662047a281fe1815df67faab143d672a2965de7b8e193188d0bbcd2fa8b8 not found: ID does not exist"
Sep 10 12:23:12.334193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.334171    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"]
Sep 10 12:23:12.339610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.339591    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb"]
Sep 10 12:23:12.390118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:12.390062    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" path="/var/lib/kubelet/pods/b1d3074f-0c1b-43c8-81b3-2591a7c37693/volumes"
Sep 10 12:23:13.543225 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:13.543179    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:14.087298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:14.087261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:14.184863 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:14.184825    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:14.382560 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:14.382528    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:14.484751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:14.484721    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:14.726757 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:14.726677    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:14.915546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:14.915514    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:15.039046 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.038961    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:15.168531 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.168499    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"]
Sep 10 12:23:15.168882 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.168870    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy"
Sep 10 12:23:15.168921 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.168883    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy"
Sep 10 12:23:15.168981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.168972    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy"
Sep 10 12:23:15.169016 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.168981    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy"
Sep 10 12:23:15.172170 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.172154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.175922 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.175901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-41f030dc-dockercfg-nnf8d\""
Sep 10 12:23:15.178303 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.178278    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-41f030dc\""
Sep 10 12:23:15.214181 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.214114    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"]
Sep 10 12:23:15.252250 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.252216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbdk\" (UniqueName: \"kubernetes.io/projected/ffda32f1-7359-47fd-a52f-06fea64ca277-kube-api-access-8mbdk\") pod \"payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.252250 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.252253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda32f1-7359-47fd-a52f-06fea64ca277-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.353617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.353538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbdk\" (UniqueName: \"kubernetes.io/projected/ffda32f1-7359-47fd-a52f-06fea64ca277-kube-api-access-8mbdk\") pod \"payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.353617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.353577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda32f1-7359-47fd-a52f-06fea64ca277-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.354307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.354286    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda32f1-7359-47fd-a52f-06fea64ca277-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.367708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.367680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbdk\" (UniqueName: \"kubernetes.io/projected/ffda32f1-7359-47fd-a52f-06fea64ca277-kube-api-access-8mbdk\") pod \"payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.483216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.483189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:15.756227 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:15.756201    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"]
Sep 10 12:23:15.758166 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:23:15.758123    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffda32f1_7359_47fd_a52f_06fea64ca277.slice/crio-34084ccf2b7f5e43f7ec0f4c6028717fc4ab2b63ba4789e689b1601a9199c082 WatchSource:0}: Error finding container 34084ccf2b7f5e43f7ec0f4c6028717fc4ab2b63ba4789e689b1601a9199c082: Status 404 returned error can't find the container with id 34084ccf2b7f5e43f7ec0f4c6028717fc4ab2b63ba4789e689b1601a9199c082
Sep 10 12:23:16.325488 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:16.325452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928" event={"ID":"ffda32f1-7359-47fd-a52f-06fea64ca277","Type":"ContainerStarted","Data":"1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c"}
Sep 10 12:23:16.325629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:16.325506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928" event={"ID":"ffda32f1-7359-47fd-a52f-06fea64ca277","Type":"ContainerStarted","Data":"34084ccf2b7f5e43f7ec0f4c6028717fc4ab2b63ba4789e689b1601a9199c082"}
Sep 10 12:23:16.325687 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:16.325633    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:16.345846 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:16.345802    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928" podStartSLOduration=1.345775226 podStartE2EDuration="1.345775226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:16.345723648 +0000 UTC m=+810.439903838" watchObservedRunningTime="2026-09-10 12:23:16.345775226 +0000 UTC m=+810.439955415"
Sep 10 12:23:27.333261 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:27.333231    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:32.334251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:32.334215    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:34.397617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:34.397585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:34.667222 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:34.667147    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:34.766766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:34.766739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:38.996406 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:38.996369    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"]
Sep 10 12:23:38.996825 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:38.996809    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy"
Sep 10 12:23:38.996873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:38.996827    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d3074f-0c1b-43c8-81b3-2591a7c37693" containerName="istio-proxy"
Sep 10 12:23:38.999581 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:38.999565    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:39.002598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.002566    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:23:39.002702 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.002654    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:23:39.009448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.009412    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"]
Sep 10 12:23:39.053319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.053293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6a4492-f86f-47a6-9ff1-da8f95840645-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww\" (UID: \"8b6a4492-f86f-47a6-9ff1-da8f95840645\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:39.154224 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.154201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6a4492-f86f-47a6-9ff1-da8f95840645-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww\" (UID: \"8b6a4492-f86f-47a6-9ff1-da8f95840645\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:39.154807 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.154787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6a4492-f86f-47a6-9ff1-da8f95840645-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww\" (UID: \"8b6a4492-f86f-47a6-9ff1-da8f95840645\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:39.310574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.310502    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:39.579971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:39.579944    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"]
Sep 10 12:23:39.581722 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:23:39.581698    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6a4492_f86f_47a6_9ff1_da8f95840645.slice/crio-0371da17d31dd0426648f3bb326416f57777293cd3b53a7e08163b479b354710 WatchSource:0}: Error finding container 0371da17d31dd0426648f3bb326416f57777293cd3b53a7e08163b479b354710: Status 404 returned error can't find the container with id 0371da17d31dd0426648f3bb326416f57777293cd3b53a7e08163b479b354710
Sep 10 12:23:40.457783 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:40.457749    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww" event={"ID":"8b6a4492-f86f-47a6-9ff1-da8f95840645","Type":"ContainerStarted","Data":"0371da17d31dd0426648f3bb326416f57777293cd3b53a7e08163b479b354710"}
Sep 10 12:23:41.079304 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:41.079249    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:41.181017 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:41.180960    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:42.473396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:42.473363    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww" event={"ID":"8b6a4492-f86f-47a6-9ff1-da8f95840645","Type":"ContainerStarted","Data":"1da05b594be2cb997bb4cb8cfe96dc2d15396b8866ef4bbc5e39d6c718423865"}
Sep 10 12:23:42.492744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:42.492698    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww" podStartSLOduration=2.085918132 podStartE2EDuration="4.492686148s" totalImagesPullingTime="2.406768016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:42.49168324 +0000 UTC m=+836.585863431" watchObservedRunningTime="2026-09-10 12:23:42.492686148 +0000 UTC m=+836.586866338"
Sep 10 12:23:43.480562 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:43.480526    2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6a4492-f86f-47a6-9ff1-da8f95840645" containerID="1da05b594be2cb997bb4cb8cfe96dc2d15396b8866ef4bbc5e39d6c718423865" exitCode=0
Sep 10 12:23:43.480923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:43.480586    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww" event={"ID":"8b6a4492-f86f-47a6-9ff1-da8f95840645","Type":"ContainerDied","Data":"1da05b594be2cb997bb4cb8cfe96dc2d15396b8866ef4bbc5e39d6c718423865"}
Sep 10 12:23:44.612407 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:44.612385    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:44.708402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:44.708375    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6a4492-f86f-47a6-9ff1-da8f95840645-maas-api-service-ca\") pod \"8b6a4492-f86f-47a6-9ff1-da8f95840645\" (UID: \"8b6a4492-f86f-47a6-9ff1-da8f95840645\") "
Sep 10 12:23:44.708695 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:44.708676    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6a4492-f86f-47a6-9ff1-da8f95840645-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b6a4492-f86f-47a6-9ff1-da8f95840645" (UID: "8b6a4492-f86f-47a6-9ff1-da8f95840645"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:23:44.809855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:44.809797    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6a4492-f86f-47a6-9ff1-da8f95840645-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:45.494050 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:45.494024    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"
Sep 10 12:23:45.494050 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:45.494032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww" event={"ID":"8b6a4492-f86f-47a6-9ff1-da8f95840645","Type":"ContainerDied","Data":"0371da17d31dd0426648f3bb326416f57777293cd3b53a7e08163b479b354710"}
Sep 10 12:23:45.494235 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:45.494074    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0371da17d31dd0426648f3bb326416f57777293cd3b53a7e08163b479b354710"
Sep 10 12:23:47.885640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:47.885605    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:47.983826 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:47.983779    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:52.391625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:52.391588    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:54.188212 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:54.188178    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:55.206184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.206153    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:55.260794 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.260765    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"]
Sep 10 12:23:55.261010 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.260968    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928" podUID="ffda32f1-7359-47fd-a52f-06fea64ca277" containerName="payload-pre-processing" containerID="cri-o://1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c" gracePeriod=30
Sep 10 12:23:55.306262 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.306237    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:55.409581 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.409553    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:55.473414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.473324    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"]
Sep 10 12:23:55.475740 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.475721    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-41f030dc-2wrww"]
Sep 10 12:23:55.484616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.484592    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:55.509647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.509631    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:55.552873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.552846    2557 generic.go:356] "Generic (PLEG): container finished" podID="ffda32f1-7359-47fd-a52f-06fea64ca277" containerID="1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c" exitCode=0
Sep 10 12:23:55.552983 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.552895    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"
Sep 10 12:23:55.552983 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.552935    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928" event={"ID":"ffda32f1-7359-47fd-a52f-06fea64ca277","Type":"ContainerDied","Data":"1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c"}
Sep 10 12:23:55.553062 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.552993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928" event={"ID":"ffda32f1-7359-47fd-a52f-06fea64ca277","Type":"ContainerDied","Data":"34084ccf2b7f5e43f7ec0f4c6028717fc4ab2b63ba4789e689b1601a9199c082"}
Sep 10 12:23:55.553062 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.553024    2557 scope.go:117] "RemoveContainer" containerID="1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c"
Sep 10 12:23:55.572026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.571705    2557 scope.go:117] "RemoveContainer" containerID="1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c"
Sep 10 12:23:55.572343 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:23:55.572306    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c\": container with ID starting with 1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c not found: ID does not exist" containerID="1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c"
Sep 10 12:23:55.572549 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.572524    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c"} err="failed to get container status \"1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c\": rpc error: code = NotFound desc = could not find container \"1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c\": container with ID starting with 1ecae2c592b40d41093dab4ea28297837296e953918df42742ba4eb4fd5f0b0c not found: ID does not exist"
Sep 10 12:23:55.598295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.597126    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda32f1-7359-47fd-a52f-06fea64ca277-plugins-config-volume\") pod \"ffda32f1-7359-47fd-a52f-06fea64ca277\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") "
Sep 10 12:23:55.598295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.597294    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mbdk\" (UniqueName: \"kubernetes.io/projected/ffda32f1-7359-47fd-a52f-06fea64ca277-kube-api-access-8mbdk\") pod \"ffda32f1-7359-47fd-a52f-06fea64ca277\" (UID: \"ffda32f1-7359-47fd-a52f-06fea64ca277\") "
Sep 10 12:23:55.598295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.597932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffda32f1-7359-47fd-a52f-06fea64ca277-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ffda32f1-7359-47fd-a52f-06fea64ca277" (UID: "ffda32f1-7359-47fd-a52f-06fea64ca277"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:23:55.601268 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.601236    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffda32f1-7359-47fd-a52f-06fea64ca277-kube-api-access-8mbdk" (OuterVolumeSpecName: "kube-api-access-8mbdk") pod "ffda32f1-7359-47fd-a52f-06fea64ca277" (UID: "ffda32f1-7359-47fd-a52f-06fea64ca277"). InnerVolumeSpecName "kube-api-access-8mbdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:23:55.665363 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.665341    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:55.698841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.698817    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mbdk\" (UniqueName: \"kubernetes.io/projected/ffda32f1-7359-47fd-a52f-06fea64ca277-kube-api-access-8mbdk\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:55.698841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.698839    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda32f1-7359-47fd-a52f-06fea64ca277-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:23:55.876970 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.876947    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"]
Sep 10 12:23:55.880006 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:55.879982    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928"]
Sep 10 12:23:56.064547 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.064520    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:56.355234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355163    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"]
Sep 10 12:23:56.355596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355562    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6a4492-f86f-47a6-9ff1-da8f95840645" containerName="revoke-keys"
Sep 10 12:23:56.355596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355574    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6a4492-f86f-47a6-9ff1-da8f95840645" containerName="revoke-keys"
Sep 10 12:23:56.355596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355590    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffda32f1-7359-47fd-a52f-06fea64ca277" containerName="payload-pre-processing"
Sep 10 12:23:56.355596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355596    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffda32f1-7359-47fd-a52f-06fea64ca277" containerName="payload-pre-processing"
Sep 10 12:23:56.355728 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355669    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffda32f1-7359-47fd-a52f-06fea64ca277" containerName="payload-pre-processing"
Sep 10 12:23:56.355728 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.355680    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6a4492-f86f-47a6-9ff1-da8f95840645" containerName="revoke-keys"
Sep 10 12:23:56.358388 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.358369    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.362173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.362155    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-67fd52b1-openshift-default-dockercfg-8mrm8\""
Sep 10 12:23:56.382625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.382602    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"]
Sep 10 12:23:56.391492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.391422    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6a4492-f86f-47a6-9ff1-da8f95840645" path="/var/lib/kubelet/pods/8b6a4492-f86f-47a6-9ff1-da8f95840645/volumes"
Sep 10 12:23:56.391861 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.391847    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffda32f1-7359-47fd-a52f-06fea64ca277" path="/var/lib/kubelet/pods/ffda32f1-7359-47fd-a52f-06fea64ca277/volumes"
Sep 10 12:23:56.398239 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.395876    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:56.506173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmftz\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-kube-api-access-qmftz\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506178    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-podinfo\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-token\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-socket\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18852270-81e0-4528-be9e-51d8eff5dd5f-istiod-ca-cert\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506533 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-envoy\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506533 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-credential-socket\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506533 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-data\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.506637 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.506542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-certs\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmftz\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-kube-api-access-qmftz\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-podinfo\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-token\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-socket\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18852270-81e0-4528-be9e-51d8eff5dd5f-istiod-ca-cert\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-envoy\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.607916 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-credential-socket\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608209 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.607939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-data\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608209 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.608172    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-certs\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.608263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-socket\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.608401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-data\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608569 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.608549    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-certs\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608694 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.608674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-credential-socket\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.608737 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.608725    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18852270-81e0-4528-be9e-51d8eff5dd5f-istiod-ca-cert\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.610014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.609998    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-envoy\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.610235 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.610220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-podinfo\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.618872 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.618847    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-token\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.619658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.619635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmftz\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-kube-api-access-qmftz\") pod \"e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") " pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.668172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.668151    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:56.944926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.944902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"]
Sep 10 12:23:56.946618 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:23:56.946587    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18852270_81e0_4528_be9e_51d8eff5dd5f.slice/crio-b69b1c4ec4f62d46a3dcc09d608362221f121cf343955258d6fa7c15d6364b5c WatchSource:0}: Error finding container b69b1c4ec4f62d46a3dcc09d608362221f121cf343955258d6fa7c15d6364b5c: Status 404 returned error can't find the container with id b69b1c4ec4f62d46a3dcc09d608362221f121cf343955258d6fa7c15d6364b5c
Sep 10 12:23:56.948647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.948616    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:23:56.948725 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.948679    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:23:56.948725 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:56.948711    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:23:57.110065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:57.110024    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:57.565498 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:57.565465    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" event={"ID":"18852270-81e0-4528-be9e-51d8eff5dd5f","Type":"ContainerStarted","Data":"ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"}
Sep 10 12:23:57.565852 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:57.565519    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" event={"ID":"18852270-81e0-4528-be9e-51d8eff5dd5f","Type":"ContainerStarted","Data":"b69b1c4ec4f62d46a3dcc09d608362221f121cf343955258d6fa7c15d6364b5c"}
Sep 10 12:23:57.620096 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:57.620048    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podStartSLOduration=1.620032502 podStartE2EDuration="1.620032502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:57.619410513 +0000 UTC m=+851.713590703" watchObservedRunningTime="2026-09-10 12:23:57.620032502 +0000 UTC m=+851.714212768"
Sep 10 12:23:57.668638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:57.668616    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:58.672859 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:58.672830    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:59.044993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:59.044913    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:59.135856 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:59.135826    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:23:59.576585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:59.576560    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:23:59.577497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:23:59.577476    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:00.299413 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.299375    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:00.411392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.411355    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:00.507320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.507275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:00.773383 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.773343    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:00.881938 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.881890    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:00.882387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.882368    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"]
Sep 10 12:24:00.885055 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.885036    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:00.887770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.887750    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:24:00.887887 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.887851    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:24:00.898823 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.898799    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"]
Sep 10 12:24:00.968588 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.968559    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"]
Sep 10 12:24:00.971818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.971782    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:00.971929 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.971818    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:00.974734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.974717    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-67fd52b1\""
Sep 10 12:24:00.985805 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:00.985786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"]
Sep 10 12:24:01.048498 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.048442    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da267e-3e04-4b45-818b-119b4e072f51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-98aa83-bsgj6\" (UID: \"c6da267e-3e04-4b45-818b-119b4e072f51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:01.048584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.048543    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad49c573-43f3-4da2-9703-9de3e310f10e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.048625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.048599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmztz\" (UniqueName: \"kubernetes.io/projected/ad49c573-43f3-4da2-9703-9de3e310f10e-kube-api-access-jmztz\") pod \"payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.149615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.149572    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmztz\" (UniqueName: \"kubernetes.io/projected/ad49c573-43f3-4da2-9703-9de3e310f10e-kube-api-access-jmztz\") pod \"payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.149806 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.149708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da267e-3e04-4b45-818b-119b4e072f51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-98aa83-bsgj6\" (UID: \"c6da267e-3e04-4b45-818b-119b4e072f51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:01.149806 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.149779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad49c573-43f3-4da2-9703-9de3e310f10e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.150537 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.150511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da267e-3e04-4b45-818b-119b4e072f51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-98aa83-bsgj6\" (UID: \"c6da267e-3e04-4b45-818b-119b4e072f51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:01.150635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.150621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad49c573-43f3-4da2-9703-9de3e310f10e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.164498 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.164475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmztz\" (UniqueName: \"kubernetes.io/projected/ad49c573-43f3-4da2-9703-9de3e310f10e-kube-api-access-jmztz\") pod \"payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.197182 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.197160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:01.281038 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.281013    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:01.366735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.366705    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:01.470974 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.470947    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"]
Sep 10 12:24:01.472113 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:24:01.472082    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6da267e_3e04_4b45_818b_119b4e072f51.slice/crio-702f23d9fca149530d8e4471d89081fd643d3adfe352a911ab96d9f4df11ac90 WatchSource:0}: Error finding container 702f23d9fca149530d8e4471d89081fd643d3adfe352a911ab96d9f4df11ac90: Status 404 returned error can't find the container with id 702f23d9fca149530d8e4471d89081fd643d3adfe352a911ab96d9f4df11ac90
Sep 10 12:24:01.558338 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.558312    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"]
Sep 10 12:24:01.559187 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:24:01.559165    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad49c573_43f3_4da2_9703_9de3e310f10e.slice/crio-39992dfaeef17feed81261942c7aa53c50f7e962df3275083fe298d0a9939712 WatchSource:0}: Error finding container 39992dfaeef17feed81261942c7aa53c50f7e962df3275083fe298d0a9939712: Status 404 returned error can't find the container with id 39992dfaeef17feed81261942c7aa53c50f7e962df3275083fe298d0a9939712
Sep 10 12:24:01.588474 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.588448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6" event={"ID":"c6da267e-3e04-4b45-818b-119b4e072f51","Type":"ContainerStarted","Data":"702f23d9fca149530d8e4471d89081fd643d3adfe352a911ab96d9f4df11ac90"}
Sep 10 12:24:01.589691 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.589669    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc" event={"ID":"ad49c573-43f3-4da2-9703-9de3e310f10e","Type":"ContainerStarted","Data":"39992dfaeef17feed81261942c7aa53c50f7e962df3275083fe298d0a9939712"}
Sep 10 12:24:01.878439 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:01.878409    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:02.273455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:02.273409    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:02.598014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:02.597912    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc" event={"ID":"ad49c573-43f3-4da2-9703-9de3e310f10e","Type":"ContainerStarted","Data":"420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc"}
Sep 10 12:24:02.598464 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:02.598061    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:02.599487 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:02.599463    2557 generic.go:356] "Generic (PLEG): container finished" podID="c6da267e-3e04-4b45-818b-119b4e072f51" containerID="adb12bc30f6921a3900d0be6a086b4786e8a8f302aed51248c50b6fcc66b40a2" exitCode=0
Sep 10 12:24:02.599598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:02.599549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6" event={"ID":"c6da267e-3e04-4b45-818b-119b4e072f51","Type":"ContainerDied","Data":"adb12bc30f6921a3900d0be6a086b4786e8a8f302aed51248c50b6fcc66b40a2"}
Sep 10 12:24:02.620735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:02.620689    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc" podStartSLOduration=2.620676755 podStartE2EDuration="2.620676755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:02.618501259 +0000 UTC m=+856.712681456" watchObservedRunningTime="2026-09-10 12:24:02.620676755 +0000 UTC m=+856.714856945"
Sep 10 12:24:03.722194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:03.722171    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:03.879219 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:03.879193    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da267e-3e04-4b45-818b-119b4e072f51-maas-api-service-ca\") pod \"c6da267e-3e04-4b45-818b-119b4e072f51\" (UID: \"c6da267e-3e04-4b45-818b-119b4e072f51\") "
Sep 10 12:24:03.879542 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:03.879521    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6da267e-3e04-4b45-818b-119b4e072f51-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6da267e-3e04-4b45-818b-119b4e072f51" (UID: "c6da267e-3e04-4b45-818b-119b4e072f51"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:24:03.980482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:03.980456    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6da267e-3e04-4b45-818b-119b4e072f51-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:04.611877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:04.611847    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"
Sep 10 12:24:04.611877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:04.611859    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6" event={"ID":"c6da267e-3e04-4b45-818b-119b4e072f51","Type":"ContainerDied","Data":"702f23d9fca149530d8e4471d89081fd643d3adfe352a911ab96d9f4df11ac90"}
Sep 10 12:24:04.612118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:04.611915    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="702f23d9fca149530d8e4471d89081fd643d3adfe352a911ab96d9f4df11ac90"
Sep 10 12:24:11.210242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:11.210203    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:11.966883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:11.966849    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:12.108742 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.108713    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:12.236034 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.235956    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:12.384875 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.384834    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:12.394705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.394678    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"]
Sep 10 12:24:12.399531 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.399507    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98aa83-bsgj6"]
Sep 10 12:24:12.510302 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.510219    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:12.798941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:12.798861    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:13.606797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:13.606764    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:14.393541 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.393506    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6da267e-3e04-4b45-818b-119b4e072f51" path="/var/lib/kubelet/pods/c6da267e-3e04-4b45-818b-119b4e072f51/volumes"
Sep 10 12:24:14.578660 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.578625    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:24:14.578833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.578691    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 12:24:14.674516 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.674415    2557 generic.go:356] "Generic (PLEG): container finished" podID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerID="ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d" exitCode=0
Sep 10 12:24:14.674516 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.674489    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" event={"ID":"18852270-81e0-4528-be9e-51d8eff5dd5f","Type":"ContainerDied","Data":"ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"}
Sep 10 12:24:14.674915 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.674900    2557 scope.go:117] "RemoveContainer" containerID="ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"
Sep 10 12:24:14.675932 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.675907    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:14.675987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.675974    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:14.676030 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:14.676006    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:15.683231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:15.683200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" event={"ID":"18852270-81e0-4528-be9e-51d8eff5dd5f","Type":"ContainerStarted","Data":"c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d"}
Sep 10 12:24:16.668651 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:16.668621    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:16.668927 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:16.668820    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:24:16.669087 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:16.669065    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 12:24:17.669198 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:17.669155    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:24:17.669696 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:17.669226    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 12:24:18.669480 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:18.669024    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:24:18.669480 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:18.669087    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 12:24:19.669110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:19.669065    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:24:19.669301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:19.669132    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 12:24:19.767811 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:19.767772    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:19.866727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:19.866696    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:20.076948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.076861    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"]
Sep 10 12:24:20.077152 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.077128    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy" containerID="cri-o://c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1" gracePeriod=30
Sep 10 12:24:20.114400 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.114377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:20.501476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.501443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:20.668787 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.668753    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 10 12:24:20.669051 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.669024    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 10 12:24:20.864347 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:20.864279    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:21.397265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:21.397227    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:21.520068 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:21.520037    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:21.673273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:21.673197    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:21.673474 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:21.673457    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:21.674056 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:21.674037    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:23.563051 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:23.563008    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:24.212703 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:24.212675    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:24.345534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:24.345503    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:24.851516 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:24.851484    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:25.320018 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.319992    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:24:25.375027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375002    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-socket\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375063    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-certs\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375098    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgjrs\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-kube-api-access-dgjrs\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375145    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-envoy\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375178    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-credential-socket\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375206    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-podinfo\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375234    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e722baa-61e8-45ce-9f93-9b4b7e327576-istiod-ca-cert\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375272    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-data\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375311    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:25.375671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375369    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:25.375671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375379    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-token\") pod \"9e722baa-61e8-45ce-9f93-9b4b7e327576\" (UID: \"9e722baa-61e8-45ce-9f93-9b4b7e327576\") "
Sep 10 12:24:25.375671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375464    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:25.375824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375793    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.375824 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375815    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.375898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375829    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.376009 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.375988    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:25.376153 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.376129    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e722baa-61e8-45ce-9f93-9b4b7e327576-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:24:25.377754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.377727    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-kube-api-access-dgjrs" (OuterVolumeSpecName: "kube-api-access-dgjrs") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "kube-api-access-dgjrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:24:25.377871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.377852    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:24:25.377927 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.377851    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:25.378123 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.378107    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e722baa-61e8-45ce-9f93-9b4b7e327576" (UID: "9e722baa-61e8-45ce-9f93-9b4b7e327576"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:24:25.477295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.477238    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.477295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.477264    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgjrs\" (UniqueName: \"kubernetes.io/projected/9e722baa-61e8-45ce-9f93-9b4b7e327576-kube-api-access-dgjrs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.477295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.477277    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.477295 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.477289    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.477500 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.477300    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e722baa-61e8-45ce-9f93-9b4b7e327576-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.477500 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.477312    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e722baa-61e8-45ce-9f93-9b4b7e327576-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:25.740175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.740096    2557 generic.go:356] "Generic (PLEG): container finished" podID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerID="c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1" exitCode=0
Sep 10 12:24:25.740175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.740144    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"
Sep 10 12:24:25.740355 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.740194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" event={"ID":"9e722baa-61e8-45ce-9f93-9b4b7e327576","Type":"ContainerDied","Data":"c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1"}
Sep 10 12:24:25.740355 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.740246    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt" event={"ID":"9e722baa-61e8-45ce-9f93-9b4b7e327576","Type":"ContainerDied","Data":"089314f43c616ebf4dd39268e267941a3fb4a8a38526214f9d639cbb20bfda3f"}
Sep 10 12:24:25.740355 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.740268    2557 scope.go:117] "RemoveContainer" containerID="c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1"
Sep 10 12:24:25.751959 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.751942    2557 scope.go:117] "RemoveContainer" containerID="4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"
Sep 10 12:24:25.760344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.760328    2557 scope.go:117] "RemoveContainer" containerID="c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1"
Sep 10 12:24:25.760600 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:24:25.760584    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1\": container with ID starting with c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1 not found: ID does not exist" containerID="c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1"
Sep 10 12:24:25.760659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.760607    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1"} err="failed to get container status \"c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1\": rpc error: code = NotFound desc = could not find container \"c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1\": container with ID starting with c97424ea0d64b0acc81fa6429237acd8673f14444b26003ff1ab5508d73c67d1 not found: ID does not exist"
Sep 10 12:24:25.760659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.760622    2557 scope.go:117] "RemoveContainer" containerID="4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"
Sep 10 12:24:25.760827 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:24:25.760812    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af\": container with ID starting with 4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af not found: ID does not exist" containerID="4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"
Sep 10 12:24:25.760905 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.760831    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af"} err="failed to get container status \"4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af\": rpc error: code = NotFound desc = could not find container \"4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af\": container with ID starting with 4e913607300a8cf1f6ccde25d7e80a9d51dace152a0c83014a6a3b7818f0b9af not found: ID does not exist"
Sep 10 12:24:25.780558 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.780527    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"]
Sep 10 12:24:25.787517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.787500    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:25.787641 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.787609    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt"]
Sep 10 12:24:25.891662 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:25.891577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:26.191657 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:26.191627    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:26.390416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:26.390386    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" path="/var/lib/kubelet/pods/9e722baa-61e8-45ce-9f93-9b4b7e327576/volumes"
Sep 10 12:24:26.390601 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:26.390513    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:26.517397 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:26.517301    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:27.029135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:27.029102    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:27.900736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:27.900703    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:30.567088 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:30.567054    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:31.231799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.231769    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:31.271815 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.271783    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"]
Sep 10 12:24:31.272700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.272668    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc" podUID="ad49c573-43f3-4da2-9703-9de3e310f10e" containerName="payload-pre-processing" containerID="cri-o://420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc" gracePeriod=30
Sep 10 12:24:31.324477 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.324441    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:31.520682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.520599    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:31.541847 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.541825    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:31.631691 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.631655    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad49c573-43f3-4da2-9703-9de3e310f10e-plugins-config-volume\") pod \"ad49c573-43f3-4da2-9703-9de3e310f10e\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") "
Sep 10 12:24:31.631691 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.631696    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmztz\" (UniqueName: \"kubernetes.io/projected/ad49c573-43f3-4da2-9703-9de3e310f10e-kube-api-access-jmztz\") pod \"ad49c573-43f3-4da2-9703-9de3e310f10e\" (UID: \"ad49c573-43f3-4da2-9703-9de3e310f10e\") "
Sep 10 12:24:31.632084 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.631973    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad49c573-43f3-4da2-9703-9de3e310f10e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad49c573-43f3-4da2-9703-9de3e310f10e" (UID: "ad49c573-43f3-4da2-9703-9de3e310f10e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:24:31.633718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.633691    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad49c573-43f3-4da2-9703-9de3e310f10e-kube-api-access-jmztz" (OuterVolumeSpecName: "kube-api-access-jmztz") pod "ad49c573-43f3-4da2-9703-9de3e310f10e" (UID: "ad49c573-43f3-4da2-9703-9de3e310f10e"). InnerVolumeSpecName "kube-api-access-jmztz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:24:31.698225 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.698202    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:31.732984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.732940    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad49c573-43f3-4da2-9703-9de3e310f10e-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:31.732984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.732979    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmztz\" (UniqueName: \"kubernetes.io/projected/ad49c573-43f3-4da2-9703-9de3e310f10e-kube-api-access-jmztz\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:31.779292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.779226    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad49c573-43f3-4da2-9703-9de3e310f10e" containerID="420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc" exitCode=0
Sep 10 12:24:31.779292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.779281    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"
Sep 10 12:24:31.779448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.779313    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc" event={"ID":"ad49c573-43f3-4da2-9703-9de3e310f10e","Type":"ContainerDied","Data":"420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc"}
Sep 10 12:24:31.779448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.779367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc" event={"ID":"ad49c573-43f3-4da2-9703-9de3e310f10e","Type":"ContainerDied","Data":"39992dfaeef17feed81261942c7aa53c50f7e962df3275083fe298d0a9939712"}
Sep 10 12:24:31.779448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.779395    2557 scope.go:117] "RemoveContainer" containerID="420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc"
Sep 10 12:24:31.788556 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.788539    2557 scope.go:117] "RemoveContainer" containerID="420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc"
Sep 10 12:24:31.788958 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:24:31.788799    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc\": container with ID starting with 420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc not found: ID does not exist" containerID="420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc"
Sep 10 12:24:31.788958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.788829    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc"} err="failed to get container status \"420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc\": rpc error: code = NotFound desc = could not find container \"420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc\": container with ID starting with 420e6c82ae62e586d7414050d5ce2ef27864fbbb16fbf3cbf31c81861b7170fc not found: ID does not exist"
Sep 10 12:24:31.800221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.800197    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:31.807360 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.807340    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"]
Sep 10 12:24:31.813562 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:31.813543    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc"]
Sep 10 12:24:32.390020 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:32.389982    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad49c573-43f3-4da2-9703-9de3e310f10e" path="/var/lib/kubelet/pods/ad49c573-43f3-4da2-9703-9de3e310f10e/volumes"
Sep 10 12:24:32.742534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:32.742456    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"]
Sep 10 12:24:32.742889 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:32.742652    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" containerID="cri-o://c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d" gracePeriod=30
Sep 10 12:24:32.762101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:32.762071    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:33.194682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.194651    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:33.540177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.540108    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"]
Sep 10 12:24:33.541723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541688    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy"
Sep 10 12:24:33.541723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541718    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy"
Sep 10 12:24:33.541908 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541733    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad49c573-43f3-4da2-9703-9de3e310f10e" containerName="payload-pre-processing"
Sep 10 12:24:33.541908 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541743    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad49c573-43f3-4da2-9703-9de3e310f10e" containerName="payload-pre-processing"
Sep 10 12:24:33.541908 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541786    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6da267e-3e04-4b45-818b-119b4e072f51" containerName="revoke-keys"
Sep 10 12:24:33.541908 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541795    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6da267e-3e04-4b45-818b-119b4e072f51" containerName="revoke-keys"
Sep 10 12:24:33.542121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.541986    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad49c573-43f3-4da2-9703-9de3e310f10e" containerName="payload-pre-processing"
Sep 10 12:24:33.542121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.542007    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy"
Sep 10 12:24:33.542121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.542024    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy"
Sep 10 12:24:33.542121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.542032    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6da267e-3e04-4b45-818b-119b4e072f51" containerName="revoke-keys"
Sep 10 12:24:33.548002 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.547873    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.551927 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.551902    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9e0ca8ed-openshift-default-dockercfg-c65p8\""
Sep 10 12:24:33.568172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.568148    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"]
Sep 10 12:24:33.584402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.584350    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649497    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-credential-socket\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istiod-ca-cert\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-podinfo\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-data\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-envoy\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnlz8\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-kube-api-access-xnlz8\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-certs\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-socket\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.649962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.649835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-token\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.750750 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.750719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-credential-socket\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.750750 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.750751    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istiod-ca-cert\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.750801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-podinfo\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.750825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-data\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.750839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-envoy\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.750859    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnlz8\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-kube-api-access-xnlz8\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751131    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-credential-socket\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751158    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-certs\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751216 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751188    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-data\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-socket\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-token\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751531    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-certs\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-socket\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.751628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.751587    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istiod-ca-cert\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.753794 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.753771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-envoy\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.753979 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.753959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-podinfo\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.755832 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.755807    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:33.766638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.766619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-token\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.767025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.767006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnlz8\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-kube-api-access-xnlz8\") pod \"e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") " pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:33.888825 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:33.888796    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:34.170632 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.170608    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"]
Sep 10 12:24:34.172096 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:24:34.172066    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75024c1_d7a8_4499_8562_2b0c2a0915ec.slice/crio-4b39ef32ea77ab86274eac147cad96732a52d43bf27135c7ec4ec4618fe240f9 WatchSource:0}: Error finding container 4b39ef32ea77ab86274eac147cad96732a52d43bf27135c7ec4ec4618fe240f9: Status 404 returned error can't find the container with id 4b39ef32ea77ab86274eac147cad96732a52d43bf27135c7ec4ec4618fe240f9
Sep 10 12:24:34.174214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.174184    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:34.174282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.174248    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:34.174282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.174276    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:34.804820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.804786    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" event={"ID":"c75024c1-d7a8-4499-8562-2b0c2a0915ec","Type":"ContainerStarted","Data":"eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"}
Sep 10 12:24:34.805169 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.804837    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" event={"ID":"c75024c1-d7a8-4499-8562-2b0c2a0915ec","Type":"ContainerStarted","Data":"4b39ef32ea77ab86274eac147cad96732a52d43bf27135c7ec4ec4618fe240f9"}
Sep 10 12:24:34.838207 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.838159    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podStartSLOduration=1.838139921 podStartE2EDuration="1.838139921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:34.835777177 +0000 UTC m=+888.929957381" watchObservedRunningTime="2026-09-10 12:24:34.838139921 +0000 UTC m=+888.932320112"
Sep 10 12:24:34.889507 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:34.889478    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:35.893966 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:35.893934    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:36.317669 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:36.317590    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:36.416715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:36.416684    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:36.675346 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:36.675313    2557 patch_prober.go:28] interesting pod/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:24:36.675534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:36.675367    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:24:36.816195 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:36.816162    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:36.817007 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:36.816988    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:37.604027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:37.603989    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:37.700711 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:37.700671    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:37.834672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:37.834645    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:37.995066 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:37.995045    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:38.092150 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092125    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-token\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092162    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-credential-socket\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092193    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmftz\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-kube-api-access-qmftz\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092231    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-envoy\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092273    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-socket\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092526 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092471    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-data\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092526 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092496    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:38.092639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092527    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:38.092639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092557    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-podinfo\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092619    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-certs\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092699    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18852270-81e0-4528-be9e-51d8eff5dd5f-istiod-ca-cert\") pod \"18852270-81e0-4528-be9e-51d8eff5dd5f\" (UID: \"18852270-81e0-4528-be9e-51d8eff5dd5f\") "
Sep 10 12:24:38.092799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092714    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:38.092905 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.092846    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:38.093061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.093042    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.093121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.093060    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.093121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.093071    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.093121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.093080    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.093121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.093094    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18852270-81e0-4528-be9e-51d8eff5dd5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:24:38.094337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.094315    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-kube-api-access-qmftz" (OuterVolumeSpecName: "kube-api-access-qmftz") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "kube-api-access-qmftz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:24:38.094448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.094375    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:24:38.094448 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.094405    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:24:38.094777 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.094762    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18852270-81e0-4528-be9e-51d8eff5dd5f" (UID: "18852270-81e0-4528-be9e-51d8eff5dd5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:24:38.195033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.194876    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18852270-81e0-4528-be9e-51d8eff5dd5f-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.195033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.194907    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.195033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.194923    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmftz\" (UniqueName: \"kubernetes.io/projected/18852270-81e0-4528-be9e-51d8eff5dd5f-kube-api-access-qmftz\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.195033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.194938    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.195033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.194953    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18852270-81e0-4528-be9e-51d8eff5dd5f-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:24:38.471930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.471827    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:38.650580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.650550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:38.732708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.732641    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"]
Sep 10 12:24:38.733223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733205    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy"
Sep 10 12:24:38.733271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733228    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy"
Sep 10 12:24:38.733271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733243    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy"
Sep 10 12:24:38.733271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733251    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy"
Sep 10 12:24:38.733271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733269    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy"
Sep 10 12:24:38.733397 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733278    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e722baa-61e8-45ce-9f93-9b4b7e327576" containerName="istio-proxy"
Sep 10 12:24:38.733452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733400    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy"
Sep 10 12:24:38.733452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.733411    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerName="istio-proxy"
Sep 10 12:24:38.737114 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.737096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:38.746394 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.746375    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-9e0ca8ed-dockercfg-5tq88\""
Sep 10 12:24:38.746984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.746967    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-9e0ca8ed\""
Sep 10 12:24:38.768820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.768790    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"]
Sep 10 12:24:38.801337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.801248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-plugins-config-volume\") pod \"payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") " pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:38.801793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.801748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcnm\" (UniqueName: \"kubernetes.io/projected/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-kube-api-access-ztcnm\") pod \"payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") " pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:38.828567 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.828534    2557 generic.go:356] "Generic (PLEG): container finished" podID="18852270-81e0-4528-be9e-51d8eff5dd5f" containerID="c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d" exitCode=0
Sep 10 12:24:38.828754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.828577    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"
Sep 10 12:24:38.828754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.828626    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" event={"ID":"18852270-81e0-4528-be9e-51d8eff5dd5f","Type":"ContainerDied","Data":"c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d"}
Sep 10 12:24:38.828754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.828676    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb" event={"ID":"18852270-81e0-4528-be9e-51d8eff5dd5f","Type":"ContainerDied","Data":"b69b1c4ec4f62d46a3dcc09d608362221f121cf343955258d6fa7c15d6364b5c"}
Sep 10 12:24:38.828754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.828703    2557 scope.go:117] "RemoveContainer" containerID="c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d"
Sep 10 12:24:38.837731 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.837702    2557 scope.go:117] "RemoveContainer" containerID="ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"
Sep 10 12:24:38.845337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.845317    2557 scope.go:117] "RemoveContainer" containerID="c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d"
Sep 10 12:24:38.845654 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:24:38.845635    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d\": container with ID starting with c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d not found: ID does not exist" containerID="c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d"
Sep 10 12:24:38.845735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.845666    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d"} err="failed to get container status \"c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d\": rpc error: code = NotFound desc = could not find container \"c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d\": container with ID starting with c7c126a8484c3b8b0667896404e0ebd0c2c265b3bf05ea4e2b67e15853ae572d not found: ID does not exist"
Sep 10 12:24:38.845735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.845687    2557 scope.go:117] "RemoveContainer" containerID="ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"
Sep 10 12:24:38.845927 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:24:38.845910    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d\": container with ID starting with ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d not found: ID does not exist" containerID="ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"
Sep 10 12:24:38.845997 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.845933    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d"} err="failed to get container status \"ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d\": rpc error: code = NotFound desc = could not find container \"ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d\": container with ID starting with ae22db29c4e19b8508038730a5ebdbeb60199ccabb84f9b301c5fe8b38c2e56d not found: ID does not exist"
Sep 10 12:24:38.877698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.877674    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"]
Sep 10 12:24:38.887408 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.887391    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb"]
Sep 10 12:24:38.902496 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.902476    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-plugins-config-volume\") pod \"payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") " pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:38.902661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.902643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcnm\" (UniqueName: \"kubernetes.io/projected/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-kube-api-access-ztcnm\") pod \"payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") " pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:38.903147 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.903127    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-plugins-config-volume\") pod \"payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") " pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:38.915817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:38.915797    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcnm\" (UniqueName: \"kubernetes.io/projected/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-kube-api-access-ztcnm\") pod \"payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") " pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:39.046514 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:39.046463    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:39.340633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:39.340611    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"]
Sep 10 12:24:39.342575 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:24:39.342546    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab8a1c8_d343_411a_a6d7_a3b3c049259a.slice/crio-47ef927a38cd7f339cb8a017d54b986536a25b5e54faa128d051cf19fc406c53 WatchSource:0}: Error finding container 47ef927a38cd7f339cb8a017d54b986536a25b5e54faa128d051cf19fc406c53: Status 404 returned error can't find the container with id 47ef927a38cd7f339cb8a017d54b986536a25b5e54faa128d051cf19fc406c53
Sep 10 12:24:39.837795 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:39.837759    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf" event={"ID":"8ab8a1c8-d343-411a-a6d7-a3b3c049259a","Type":"ContainerStarted","Data":"87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d"}
Sep 10 12:24:39.838210 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:39.837812    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:39.838210 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:39.837835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf" event={"ID":"8ab8a1c8-d343-411a-a6d7-a3b3c049259a","Type":"ContainerStarted","Data":"47ef927a38cd7f339cb8a017d54b986536a25b5e54faa128d051cf19fc406c53"}
Sep 10 12:24:39.876755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:39.876710    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf" podStartSLOduration=1.876696433 podStartE2EDuration="1.876696433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:39.876569119 +0000 UTC m=+893.970749311" watchObservedRunningTime="2026-09-10 12:24:39.876696433 +0000 UTC m=+893.970876623"
Sep 10 12:24:40.390500 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:40.390471    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18852270-81e0-4528-be9e-51d8eff5dd5f" path="/var/lib/kubelet/pods/18852270-81e0-4528-be9e-51d8eff5dd5f/volumes"
Sep 10 12:24:47.084269 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:47.084231    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:47.387571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:47.387539    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:47.635585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:47.635552    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:49.014352 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:49.014304    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:49.160756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:49.160722    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:24:50.846258 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:50.846219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:24:52.415024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.414912    2557 patch_prober.go:28] interesting pod/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:49974->10.133.0.51:15021: read: connection reset by peer" start-of-body=
Sep 10 12:24:52.415024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.414981    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:49974->10.133.0.51:15021: read: connection reset by peer"
Sep 10 12:24:52.921111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.921083    2557 generic.go:356] "Generic (PLEG): container finished" podID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerID="eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570" exitCode=0
Sep 10 12:24:52.921255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.921159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" event={"ID":"c75024c1-d7a8-4499-8562-2b0c2a0915ec","Type":"ContainerDied","Data":"eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"}
Sep 10 12:24:52.921548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.921532    2557 scope.go:117] "RemoveContainer" containerID="eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"
Sep 10 12:24:52.922491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.922467    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:52.922564 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.922529    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:52.922564 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:52.922558    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:24:53.928854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:53.928822    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" event={"ID":"c75024c1-d7a8-4499-8562-2b0c2a0915ec","Type":"ContainerStarted","Data":"388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3"}
Sep 10 12:24:54.889751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:54.889717    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:54.889923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:54.889836    2557 patch_prober.go:28] interesting pod/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 12:24:54.889923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:54.889875    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 12:24:55.889913 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:55.889878    2557 patch_prober.go:28] interesting pod/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 12:24:55.890288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:55.889941    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 12:24:56.889927 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:56.889892    2557 patch_prober.go:28] interesting pod/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 12:24:56.890292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:56.889979    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 12:24:57.889666 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:57.889631    2557 patch_prober.go:28] interesting pod/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 12:24:57.889847 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:57.889679    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 12:24:58.902387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:58.902353    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:58.902906 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:58.902710    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:58.903489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:58.903469    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:24:59.244164 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:24:59.244086    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:08.552715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.552677    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:08.616913 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.616882    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"]
Sep 10 12:25:08.617163 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.617126    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf" podUID="8ab8a1c8-d343-411a-a6d7-a3b3c049259a" containerName="payload-processing" containerID="cri-o://87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d" gracePeriod=30
Sep 10 12:25:08.865627 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.865584    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:25:08.871635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.871608    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:08.995797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.994946    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztcnm\" (UniqueName: \"kubernetes.io/projected/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-kube-api-access-ztcnm\") pod \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") "
Sep 10 12:25:08.995797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.995055    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-plugins-config-volume\") pod \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\" (UID: \"8ab8a1c8-d343-411a-a6d7-a3b3c049259a\") "
Sep 10 12:25:08.995797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.995788    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ab8a1c8-d343-411a-a6d7-a3b3c049259a" (UID: "8ab8a1c8-d343-411a-a6d7-a3b3c049259a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:25:09.000618 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:08.999791    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-kube-api-access-ztcnm" (OuterVolumeSpecName: "kube-api-access-ztcnm") pod "8ab8a1c8-d343-411a-a6d7-a3b3c049259a" (UID: "8ab8a1c8-d343-411a-a6d7-a3b3c049259a"). InnerVolumeSpecName "kube-api-access-ztcnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:25:09.017693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.017631    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ab8a1c8-d343-411a-a6d7-a3b3c049259a" containerID="87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d" exitCode=0
Sep 10 12:25:09.017693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.017681    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"
Sep 10 12:25:09.017693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.017686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf" event={"ID":"8ab8a1c8-d343-411a-a6d7-a3b3c049259a","Type":"ContainerDied","Data":"87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d"}
Sep 10 12:25:09.017942 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.017741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf" event={"ID":"8ab8a1c8-d343-411a-a6d7-a3b3c049259a","Type":"ContainerDied","Data":"47ef927a38cd7f339cb8a017d54b986536a25b5e54faa128d051cf19fc406c53"}
Sep 10 12:25:09.017942 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.017768    2557 scope.go:117] "RemoveContainer" containerID="87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d"
Sep 10 12:25:09.028532 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.028505    2557 scope.go:117] "RemoveContainer" containerID="87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d"
Sep 10 12:25:09.029005 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:25:09.028982    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d\": container with ID starting with 87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d not found: ID does not exist" containerID="87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d"
Sep 10 12:25:09.029157 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.029137    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d"} err="failed to get container status \"87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d\": rpc error: code = NotFound desc = could not find container \"87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d\": container with ID starting with 87aed8f6238a678a943cbc98847b33c8359729a213659e6ceff4b2a90948808d not found: ID does not exist"
Sep 10 12:25:09.049613 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.049592    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"]
Sep 10 12:25:09.061764 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.061743    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf"]
Sep 10 12:25:09.096557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.096511    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:09.096557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.096528    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztcnm\" (UniqueName: \"kubernetes.io/projected/8ab8a1c8-d343-411a-a6d7-a3b3c049259a-kube-api-access-ztcnm\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:09.164111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.164087    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:09.351455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.351361    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:09.459889 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.459853    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"]
Sep 10 12:25:09.460075 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.460051    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" containerID="cri-o://388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3" gracePeriod=30
Sep 10 12:25:09.534901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:09.534877    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:10.274566 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:10.274534    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:10.389986 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:10.389957    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab8a1c8-d343-411a-a6d7-a3b3c049259a" path="/var/lib/kubelet/pods/8ab8a1c8-d343-411a-a6d7-a3b3c049259a/volumes"
Sep 10 12:25:10.440706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:10.440676    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:12.053813 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:12.053783    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:13.905524 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:13.905486    2557 patch_prober.go:28] interesting pod/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:25:13.905887 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:13.905545    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:25:14.703402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.703371    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:25:14.844548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844481    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnlz8\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-kube-api-access-xnlz8\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844529    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-envoy\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844557    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-data\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844585    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-certs\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844601    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-token\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844657    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-podinfo\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844713    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istiod-ca-cert\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844756    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-credential-socket\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844812    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-socket\") pod \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\" (UID: \"c75024c1-d7a8-4499-8562-2b0c2a0915ec\") "
Sep 10 12:25:14.844993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844884    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:25:14.844993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.844902    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:25:14.845256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.845083    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:25:14.845256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.845098    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:25:14.845256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.845161    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.845256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.845214    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.845499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.845307    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:25:14.846657 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.846634    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:25:14.846755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.846651    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-kube-api-access-xnlz8" (OuterVolumeSpecName: "kube-api-access-xnlz8") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "kube-api-access-xnlz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:25:14.846797 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.846767    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:25:14.846843 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.846827    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c75024c1-d7a8-4499-8562-2b0c2a0915ec" (UID: "c75024c1-d7a8-4499-8562-2b0c2a0915ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:25:14.946268 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946246    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnlz8\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-kube-api-access-xnlz8\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.946268 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946267    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.946624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946279    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.946624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946288    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.946624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946297    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75024c1-d7a8-4499-8562-2b0c2a0915ec-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.946624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946306    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:14.946624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:14.946314    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75024c1-d7a8-4499-8562-2b0c2a0915ec-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:15.052765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.052742    2557 generic.go:356] "Generic (PLEG): container finished" podID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerID="388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3" exitCode=0
Sep 10 12:25:15.052859 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.052791    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"
Sep 10 12:25:15.052859 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.052826    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" event={"ID":"c75024c1-d7a8-4499-8562-2b0c2a0915ec","Type":"ContainerDied","Data":"388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3"}
Sep 10 12:25:15.052933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.052882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg" event={"ID":"c75024c1-d7a8-4499-8562-2b0c2a0915ec","Type":"ContainerDied","Data":"4b39ef32ea77ab86274eac147cad96732a52d43bf27135c7ec4ec4618fe240f9"}
Sep 10 12:25:15.052933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.052904    2557 scope.go:117] "RemoveContainer" containerID="388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3"
Sep 10 12:25:15.062299 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.062282    2557 scope.go:117] "RemoveContainer" containerID="eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"
Sep 10 12:25:15.070408 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.070393    2557 scope.go:117] "RemoveContainer" containerID="388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3"
Sep 10 12:25:15.071135 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:25:15.071115    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3\": container with ID starting with 388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3 not found: ID does not exist" containerID="388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3"
Sep 10 12:25:15.071181 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.071142    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3"} err="failed to get container status \"388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3\": rpc error: code = NotFound desc = could not find container \"388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3\": container with ID starting with 388908984b8a7ee27b51b7efe7d2f734e32a6343a9d956023250f704f065c9f3 not found: ID does not exist"
Sep 10 12:25:15.071181 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.071158    2557 scope.go:117] "RemoveContainer" containerID="eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"
Sep 10 12:25:15.071396 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:25:15.071377    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570\": container with ID starting with eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570 not found: ID does not exist" containerID="eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"
Sep 10 12:25:15.071453 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.071402    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570"} err="failed to get container status \"eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570\": rpc error: code = NotFound desc = could not find container \"eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570\": container with ID starting with eed8c5ec2bb0a136b564a05be26d763b69b8ac03151a7dca2d4d7e830bdd9570 not found: ID does not exist"
Sep 10 12:25:15.086121 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.086101    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"]
Sep 10 12:25:15.089549 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:15.089530    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg"]
Sep 10 12:25:16.391866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:16.391826    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" path="/var/lib/kubelet/pods/c75024c1-d7a8-4499-8562-2b0c2a0915ec/volumes"
Sep 10 12:25:19.025085 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:19.025041    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:19.149091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:19.149064    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:19.283664 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:19.283594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:19.485381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:19.485339    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:19.824949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:19.824921    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:22.953315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:22.953274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:30.623695 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:30.623660    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:45.789359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:45.789326    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:50.761724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.761682    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:50.806324 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806295    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"]
Sep 10 12:25:50.806700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806688    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy"
Sep 10 12:25:50.806746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806702    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy"
Sep 10 12:25:50.806746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806709    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab8a1c8-d343-411a-a6d7-a3b3c049259a" containerName="payload-processing"
Sep 10 12:25:50.806746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806714    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab8a1c8-d343-411a-a6d7-a3b3c049259a" containerName="payload-processing"
Sep 10 12:25:50.806842 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806784    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab8a1c8-d343-411a-a6d7-a3b3c049259a" containerName="payload-processing"
Sep 10 12:25:50.806842 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806792    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy"
Sep 10 12:25:50.806842 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.806798    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy"
Sep 10 12:25:50.809476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.809460    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:50.815313 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.815293    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:25:50.815462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.815350    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:25:50.826122 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.826101    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"]
Sep 10 12:25:50.832090 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.832061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13a5d8e-d638-43bf-a3ae-099e385c596c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f615cc-478mn\" (UID: \"d13a5d8e-d638-43bf-a3ae-099e385c596c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:50.933293 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.933266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13a5d8e-d638-43bf-a3ae-099e385c596c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f615cc-478mn\" (UID: \"d13a5d8e-d638-43bf-a3ae-099e385c596c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:50.933872 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.933851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13a5d8e-d638-43bf-a3ae-099e385c596c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f615cc-478mn\" (UID: \"d13a5d8e-d638-43bf-a3ae-099e385c596c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:50.980775 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:50.980753    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:51.119283 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:51.119258    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:51.399955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:51.399931    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"]
Sep 10 12:25:51.401039 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:25:51.401016    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13a5d8e_d638_43bf_a3ae_099e385c596c.slice/crio-ecd2e01a2f48be6d91c847e778acc9087acfb2d8e666e3792d722c38abe562f9 WatchSource:0}: Error finding container ecd2e01a2f48be6d91c847e778acc9087acfb2d8e666e3792d722c38abe562f9: Status 404 returned error can't find the container with id ecd2e01a2f48be6d91c847e778acc9087acfb2d8e666e3792d722c38abe562f9
Sep 10 12:25:52.260999 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:52.260968    2557 generic.go:356] "Generic (PLEG): container finished" podID="d13a5d8e-d638-43bf-a3ae-099e385c596c" containerID="e8784b2b156a8c399af1f373e87031ba5523327e75dc471c6c872d61b06c3925" exitCode=0
Sep 10 12:25:52.261315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:52.261058    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn" event={"ID":"d13a5d8e-d638-43bf-a3ae-099e385c596c","Type":"ContainerDied","Data":"e8784b2b156a8c399af1f373e87031ba5523327e75dc471c6c872d61b06c3925"}
Sep 10 12:25:52.261315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:52.261106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn" event={"ID":"d13a5d8e-d638-43bf-a3ae-099e385c596c","Type":"ContainerStarted","Data":"ecd2e01a2f48be6d91c847e778acc9087acfb2d8e666e3792d722c38abe562f9"}
Sep 10 12:25:53.391839 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:53.391818    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:53.455791 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:53.455766    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13a5d8e-d638-43bf-a3ae-099e385c596c-maas-api-service-ca\") pod \"d13a5d8e-d638-43bf-a3ae-099e385c596c\" (UID: \"d13a5d8e-d638-43bf-a3ae-099e385c596c\") "
Sep 10 12:25:53.456119 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:53.456095    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13a5d8e-d638-43bf-a3ae-099e385c596c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d13a5d8e-d638-43bf-a3ae-099e385c596c" (UID: "d13a5d8e-d638-43bf-a3ae-099e385c596c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:25:53.556653 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:53.556600    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d13a5d8e-d638-43bf-a3ae-099e385c596c-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:25:53.580956 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:53.580935    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:53.815861 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:53.815785    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:25:54.273199 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:54.273174    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"
Sep 10 12:25:54.273363 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:54.273178    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn" event={"ID":"d13a5d8e-d638-43bf-a3ae-099e385c596c","Type":"ContainerDied","Data":"ecd2e01a2f48be6d91c847e778acc9087acfb2d8e666e3792d722c38abe562f9"}
Sep 10 12:25:54.273363 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:25:54.273296    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecd2e01a2f48be6d91c847e778acc9087acfb2d8e666e3792d722c38abe562f9"
Sep 10 12:26:01.456457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:01.456411    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:01.638134 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:01.638103    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:01.816178 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:01.816101    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:01.844817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:01.844782    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"]
Sep 10 12:26:01.859237 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:01.859213    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f615cc-478mn"]
Sep 10 12:26:01.921060 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:01.921024    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:02.216864 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:02.216837    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:02.389795 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:02.389767    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d13a5d8e-d638-43bf-a3ae-099e385c596c" path="/var/lib/kubelet/pods/d13a5d8e-d638-43bf-a3ae-099e385c596c/volumes"
Sep 10 12:26:02.456455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:02.456413    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:09.623717 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:09.623637    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:09.728678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:09.728649    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:09.901391 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:09.901311    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:10.352483 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:10.352406    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:10.692614 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:10.692577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:10.958453 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:10.958347    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:11.912948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:11.912920    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:12.028601 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:12.028572    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:12.146820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:12.146790    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:15.756141 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:15.756112    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:15.860391 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:15.860358    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:15.955913 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:15.955878    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:22.110019 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:22.109984    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:23.944533 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:23.944485    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:24.065642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:24.065609    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:24.287681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:24.287596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:24.389277 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:24.389247    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:26.426841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:26.426813    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:27.167734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:27.167699    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:29.630270 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:29.630238    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:33.636953 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:33.636922    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:33.747710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:33.747681    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:33.850132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:33.850102    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:33.962447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:33.962359    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:34.604638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:34.604608    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:35.127606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:35.127577    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:35.941700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:35.941670    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:36.246407 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:36.246335    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:42.131158 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:42.131127    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:43.131587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:43.131556    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:43.437451 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:43.437360    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:44.012124 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:44.012093    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:44.109823 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:44.109798    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:44.752590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:44.752560    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:46.154208 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:46.154174    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:46.258584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:46.258559    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:51.765837 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:51.765804    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:51.883992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:51.883962    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:51.990037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:51.990006    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:52.455367 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:52.455336    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:52.590622 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:52.590585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:53.988301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:53.988251    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:54.060705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.060672    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"]
Sep 10 12:26:54.060903 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.060883    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x" podUID="31fa993a-1255-488e-90a2-f8e5fe1f251b" containerName="payload-processing" containerID="cri-o://c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b" gracePeriod=30
Sep 10 12:26:54.111625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.111596    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:54.302406 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.302340    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:54.320814 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.320781    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:26:54.355097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.355067    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9r6z\" (UniqueName: \"kubernetes.io/projected/31fa993a-1255-488e-90a2-f8e5fe1f251b-kube-api-access-f9r6z\") pod \"31fa993a-1255-488e-90a2-f8e5fe1f251b\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") "
Sep 10 12:26:54.355233 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.355225    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31fa993a-1255-488e-90a2-f8e5fe1f251b-plugins-config-volume\") pod \"31fa993a-1255-488e-90a2-f8e5fe1f251b\" (UID: \"31fa993a-1255-488e-90a2-f8e5fe1f251b\") "
Sep 10 12:26:54.355596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.355575    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31fa993a-1255-488e-90a2-f8e5fe1f251b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31fa993a-1255-488e-90a2-f8e5fe1f251b" (UID: "31fa993a-1255-488e-90a2-f8e5fe1f251b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:26:54.357023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.357004    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fa993a-1255-488e-90a2-f8e5fe1f251b-kube-api-access-f9r6z" (OuterVolumeSpecName: "kube-api-access-f9r6z") pod "31fa993a-1255-488e-90a2-f8e5fe1f251b" (UID: "31fa993a-1255-488e-90a2-f8e5fe1f251b"). InnerVolumeSpecName "kube-api-access-f9r6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:26:54.456736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.456708    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31fa993a-1255-488e-90a2-f8e5fe1f251b-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:26:54.456736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.456737    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9r6z\" (UniqueName: \"kubernetes.io/projected/31fa993a-1255-488e-90a2-f8e5fe1f251b-kube-api-access-f9r6z\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:26:54.520688 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.520663    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:54.603194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.603124    2557 generic.go:356] "Generic (PLEG): container finished" podID="31fa993a-1255-488e-90a2-f8e5fe1f251b" containerID="c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b" exitCode=0
Sep 10 12:26:54.603194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.603172    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"
Sep 10 12:26:54.603352 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.603209    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x" event={"ID":"31fa993a-1255-488e-90a2-f8e5fe1f251b","Type":"ContainerDied","Data":"c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b"}
Sep 10 12:26:54.603352 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.603258    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x" event={"ID":"31fa993a-1255-488e-90a2-f8e5fe1f251b","Type":"ContainerDied","Data":"8027aefc9288f5275e5eab179badc3c1bec33f7eaa8cff21a51b332f18bfd495"}
Sep 10 12:26:54.603352 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.603280    2557 scope.go:117] "RemoveContainer" containerID="c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b"
Sep 10 12:26:54.611812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.611795    2557 scope.go:117] "RemoveContainer" containerID="c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b"
Sep 10 12:26:54.612111 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:26:54.612089    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b\": container with ID starting with c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b not found: ID does not exist" containerID="c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b"
Sep 10 12:26:54.612188 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.612119    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b"} err="failed to get container status \"c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b\": rpc error: code = NotFound desc = could not find container \"c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b\": container with ID starting with c50519cb4625e65d63c6b29d65c1411c8914a51ea3b32cc085e5514c14bd463b not found: ID does not exist"
Sep 10 12:26:54.643697 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.643675    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"]
Sep 10 12:26:54.658438 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.658400    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x"]
Sep 10 12:26:54.699359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.699341    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:54.966489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:54.966462    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:56.390754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:56.390725    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31fa993a-1255-488e-90a2-f8e5fe1f251b" path="/var/lib/kubelet/pods/31fa993a-1255-488e-90a2-f8e5fe1f251b/volumes"
Sep 10 12:26:56.409487 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:56.409460    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:56.558572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:56.558545    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:57.781534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:57.781503    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:58.006640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:58.006609    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:58.454553 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:58.454521    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:26:58.566183 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:26:58.566155    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:01.468471 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:01.468417    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:01.570688 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:01.570659    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:01.726094 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:01.726015    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"]
Sep 10 12:27:01.726250 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:01.726225    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy" containerID="cri-o://a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b" gracePeriod=30
Sep 10 12:27:01.741118 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:01.741095    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:02.267638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:02.267605    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:06.779988 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:06.779956    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:06.959387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:06.959362    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:27:07.065226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065158    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-credential-socket\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065198    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-certs\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065219    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-token\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065240    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-socket\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065263    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d817175-1e42-41be-aa71-17fd93e40f1a-istiod-ca-cert\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065379    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-podinfo\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065466    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-data\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065483    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065496    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-envoy\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065513 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065511    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:07.065871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065586    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:07.065871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065634    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nwsk\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-kube-api-access-4nwsk\") pod \"3d817175-1e42-41be-aa71-17fd93e40f1a\" (UID: \"3d817175-1e42-41be-aa71-17fd93e40f1a\") "
Sep 10 12:27:07.065871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065704    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:07.066015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065934    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d817175-1e42-41be-aa71-17fd93e40f1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:27:07.066015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065940    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.066015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065983    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.066015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.065998    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.066015 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.066010    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.067368 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.067343    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:07.067661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.067645    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-kube-api-access-4nwsk" (OuterVolumeSpecName: "kube-api-access-4nwsk") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "kube-api-access-4nwsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:27:07.067762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.067735    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:27:07.067762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.067739    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d817175-1e42-41be-aa71-17fd93e40f1a" (UID: "3d817175-1e42-41be-aa71-17fd93e40f1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:27:07.167319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.167294    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.167319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.167315    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d817175-1e42-41be-aa71-17fd93e40f1a-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.167485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.167324    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.167485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.167331    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d817175-1e42-41be-aa71-17fd93e40f1a-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.167485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.167350    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nwsk\" (UniqueName: \"kubernetes.io/projected/3d817175-1e42-41be-aa71-17fd93e40f1a-kube-api-access-4nwsk\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:07.677684 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.677647    2557 generic.go:356] "Generic (PLEG): container finished" podID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerID="a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b" exitCode=0
Sep 10 12:27:07.677684 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.677684    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"
Sep 10 12:27:07.677899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.677709    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" event={"ID":"3d817175-1e42-41be-aa71-17fd93e40f1a","Type":"ContainerDied","Data":"a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b"}
Sep 10 12:27:07.677899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.677763    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8" event={"ID":"3d817175-1e42-41be-aa71-17fd93e40f1a","Type":"ContainerDied","Data":"64847714f1850d950093444afb096a61195d245810d38275a160ea1d9e1846a0"}
Sep 10 12:27:07.677899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.677784    2557 scope.go:117] "RemoveContainer" containerID="a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b"
Sep 10 12:27:07.687274 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.687254    2557 scope.go:117] "RemoveContainer" containerID="0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"
Sep 10 12:27:07.696885 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:27:07.696857    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d817175_1e42_41be_aa71_17fd93e40f1a.slice/crio-64847714f1850d950093444afb096a61195d245810d38275a160ea1d9e1846a0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d817175_1e42_41be_aa71_17fd93e40f1a.slice\": RecentStats: unable to find data in memory cache]"
Sep 10 12:27:07.697097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.697082    2557 scope.go:117] "RemoveContainer" containerID="a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b"
Sep 10 12:27:07.697331 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:27:07.697315    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b\": container with ID starting with a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b not found: ID does not exist" containerID="a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b"
Sep 10 12:27:07.697375 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.697338    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b"} err="failed to get container status \"a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b\": rpc error: code = NotFound desc = could not find container \"a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b\": container with ID starting with a23e23aad42367b5910dc07899fac3d1559a262ebbaae87a87df474643d9de0b not found: ID does not exist"
Sep 10 12:27:07.697375 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.697353    2557 scope.go:117] "RemoveContainer" containerID="0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"
Sep 10 12:27:07.697602 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:27:07.697585    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f\": container with ID starting with 0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f not found: ID does not exist" containerID="0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"
Sep 10 12:27:07.697650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.697607    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f"} err="failed to get container status \"0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f\": rpc error: code = NotFound desc = could not find container \"0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f\": container with ID starting with 0284393d0330c9ddf9928edefac1e779fe1cf685fb7b313e1588433be0c7174f not found: ID does not exist"
Sep 10 12:27:07.703733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.703714    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"]
Sep 10 12:27:07.714472 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:07.714445    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8"]
Sep 10 12:27:08.389771 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:08.389741    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" path="/var/lib/kubelet/pods/3d817175-1e42-41be-aa71-17fd93e40f1a/volumes"
Sep 10 12:27:12.644540 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.644511    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:12.667971 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.667941    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"]
Sep 10 12:27:12.668154 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.668122    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl" podUID="13502297-dcde-422b-8779-2e3c55bd6986" containerName="payload-processing" containerID="cri-o://42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece" gracePeriod=30
Sep 10 12:27:12.746644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.746608    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:12.846392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.846358    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:12.924880 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.924856    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:27:12.927676 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:12.927651    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:13.014117 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.014083    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmhpv\" (UniqueName: \"kubernetes.io/projected/13502297-dcde-422b-8779-2e3c55bd6986-kube-api-access-dmhpv\") pod \"13502297-dcde-422b-8779-2e3c55bd6986\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") "
Sep 10 12:27:13.014299 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.014180    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13502297-dcde-422b-8779-2e3c55bd6986-plugins-config-volume\") pod \"13502297-dcde-422b-8779-2e3c55bd6986\" (UID: \"13502297-dcde-422b-8779-2e3c55bd6986\") "
Sep 10 12:27:13.014643 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.014617    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13502297-dcde-422b-8779-2e3c55bd6986-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13502297-dcde-422b-8779-2e3c55bd6986" (UID: "13502297-dcde-422b-8779-2e3c55bd6986"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:27:13.016189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.016169    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13502297-dcde-422b-8779-2e3c55bd6986-kube-api-access-dmhpv" (OuterVolumeSpecName: "kube-api-access-dmhpv") pod "13502297-dcde-422b-8779-2e3c55bd6986" (UID: "13502297-dcde-422b-8779-2e3c55bd6986"). InnerVolumeSpecName "kube-api-access-dmhpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:27:13.115901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.115867    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13502297-dcde-422b-8779-2e3c55bd6986-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:13.115901 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.115893    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmhpv\" (UniqueName: \"kubernetes.io/projected/13502297-dcde-422b-8779-2e3c55bd6986-kube-api-access-dmhpv\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:13.246583 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.246478    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:13.712207 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.712169    2557 generic.go:356] "Generic (PLEG): container finished" podID="13502297-dcde-422b-8779-2e3c55bd6986" containerID="42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece" exitCode=0
Sep 10 12:27:13.712584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.712228    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"
Sep 10 12:27:13.712584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.712244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl" event={"ID":"13502297-dcde-422b-8779-2e3c55bd6986","Type":"ContainerDied","Data":"42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece"}
Sep 10 12:27:13.712584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.712316    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl" event={"ID":"13502297-dcde-422b-8779-2e3c55bd6986","Type":"ContainerDied","Data":"729be0847154877715ed1311056592edcac289358068052ade2d6b6f26406d46"}
Sep 10 12:27:13.712584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.712338    2557 scope.go:117] "RemoveContainer" containerID="42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece"
Sep 10 12:27:13.721710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.721692    2557 scope.go:117] "RemoveContainer" containerID="42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece"
Sep 10 12:27:13.721980 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:27:13.721959    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece\": container with ID starting with 42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece not found: ID does not exist" containerID="42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece"
Sep 10 12:27:13.722041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.721988    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece"} err="failed to get container status \"42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece\": rpc error: code = NotFound desc = could not find container \"42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece\": container with ID starting with 42f3c602de5e655d4329aec5ceaa06676f19032674e60c6cafdb61126bd54ece not found: ID does not exist"
Sep 10 12:27:13.741962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.741941    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"]
Sep 10 12:27:13.755525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:13.755503    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl"]
Sep 10 12:27:14.391014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:14.390971    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13502297-dcde-422b-8779-2e3c55bd6986" path="/var/lib/kubelet/pods/13502297-dcde-422b-8779-2e3c55bd6986/volumes"
Sep 10 12:27:19.075217 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:19.075188    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:20.712771 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:20.712728    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:20.880474 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:20.880443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:20.994222 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:20.994137    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"]
Sep 10 12:27:20.994417 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:20.994378    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" containerID="cri-o://c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0" gracePeriod=30
Sep 10 12:27:21.035334 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.035291    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:21.184527 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.184483    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:21.574276 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.574246    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:21.856874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.856850    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:21.938670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.938640    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"]
Sep 10 12:27:21.939001 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.938989    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d13a5d8e-d638-43bf-a3ae-099e385c596c" containerName="revoke-keys"
Sep 10 12:27:21.939047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939002    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d13a5d8e-d638-43bf-a3ae-099e385c596c" containerName="revoke-keys"
Sep 10 12:27:21.939047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939015    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy"
Sep 10 12:27:21.939047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939021    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy"
Sep 10 12:27:21.939047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939033    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13502297-dcde-422b-8779-2e3c55bd6986" containerName="payload-processing"
Sep 10 12:27:21.939047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939039    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="13502297-dcde-422b-8779-2e3c55bd6986" containerName="payload-processing"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939050    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939055    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939062    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939066    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75024c1-d7a8-4499-8562-2b0c2a0915ec" containerName="istio-proxy"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939076    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fa993a-1255-488e-90a2-f8e5fe1f251b" containerName="payload-processing"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939090    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fa993a-1255-488e-90a2-f8e5fe1f251b" containerName="payload-processing"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939143    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939150    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="13502297-dcde-422b-8779-2e3c55bd6986" containerName="payload-processing"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939157    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d13a5d8e-d638-43bf-a3ae-099e385c596c" containerName="revoke-keys"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939164    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="31fa993a-1255-488e-90a2-f8e5fe1f251b" containerName="payload-processing"
Sep 10 12:27:21.939203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.939170    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d817175-1e42-41be-aa71-17fd93e40f1a" containerName="istio-proxy"
Sep 10 12:27:21.942197 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.942182    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:21.946645 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.946625    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-18c2d2-openshift-default-dockercfg-jnddt\""
Sep 10 12:27:21.957587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.957566    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"]
Sep 10 12:27:21.985488 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:21.985463    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:22.093325 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09b28d4f-0847-48ec-acab-561d4d33c162-istiod-ca-cert\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093543 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-istio-token\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093543 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtf2\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-kube-api-access-wqtf2\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093543 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-socket\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093543 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09b28d4f-0847-48ec-acab-561d4d33c162-istio-podinfo\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-certs\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-credential-socket\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093677    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-data\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.093762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.093749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-envoy\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.134338 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.134271    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:22.194572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-data\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-envoy\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194621    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09b28d4f-0847-48ec-acab-561d4d33c162-istiod-ca-cert\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-istio-token\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtf2\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-kube-api-access-wqtf2\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194680    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-socket\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194985 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09b28d4f-0847-48ec-acab-561d4d33c162-istio-podinfo\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194985 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-certs\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.194985 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.194953    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-data\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.195153 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.195002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-credential-socket\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.195153 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.195072    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-certs\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.195153 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.195135    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-socket\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.195341 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.195314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-credential-socket\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.195386 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.195371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09b28d4f-0847-48ec-acab-561d4d33c162-istiod-ca-cert\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.196856 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.196837    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-envoy\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.197169 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.197151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09b28d4f-0847-48ec-acab-561d4d33c162-istio-podinfo\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.203577 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.203559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-istio-token\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.203735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.203720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtf2\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-kube-api-access-wqtf2\") pod \"e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") " pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.240343 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.240322    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:22.252372 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.252351    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:22.537344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.537316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"]
Sep 10 12:27:22.538728 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:27:22.538705    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b28d4f_0847_48ec_acab_561d4d33c162.slice/crio-7fcc405d97a7651dcd79416607aa5db610265df82fddfbef14ecf002b2ced93f WatchSource:0}: Error finding container 7fcc405d97a7651dcd79416607aa5db610265df82fddfbef14ecf002b2ced93f: Status 404 returned error can't find the container with id 7fcc405d97a7651dcd79416607aa5db610265df82fddfbef14ecf002b2ced93f
Sep 10 12:27:22.540997 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.540963    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:27:22.541063 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.541041    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:27:22.541097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.541083    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:27:22.763502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.763471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" event={"ID":"09b28d4f-0847-48ec-acab-561d4d33c162","Type":"ContainerStarted","Data":"fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"}
Sep 10 12:27:22.763502 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.763517    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" event={"ID":"09b28d4f-0847-48ec-acab-561d4d33c162","Type":"ContainerStarted","Data":"7fcc405d97a7651dcd79416607aa5db610265df82fddfbef14ecf002b2ced93f"}
Sep 10 12:27:22.794263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:22.794166    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podStartSLOduration=1.794146913 podStartE2EDuration="1.794146913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:27:22.791097955 +0000 UTC m=+1056.885278147" watchObservedRunningTime="2026-09-10 12:27:22.794146913 +0000 UTC m=+1056.888327103"
Sep 10 12:27:23.252917 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:23.252890    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:23.257598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:23.257571    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:23.768873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:23.768837    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:23.769733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:23.769712    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:24.809610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:24.809579    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:24.989026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:24.988993    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:25.712858 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:25.712792    2557 patch_prober.go:28] interesting pod/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:27:25.713049 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:25.712882    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:27:26.081000 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.080972    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:26.197902 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.197876    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:26.239983 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.239963    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:27:26.328293 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328233    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-data\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328293 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328275    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-socket\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328310    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-token\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328341    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-credential-socket\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328364    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxf4m\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-kube-api-access-dxf4m\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328381    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-podinfo\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328395    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-envoy\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328421    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-certs\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328517 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328504    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81994ee7-7267-4ebc-91cf-6588a4b754f7-istiod-ca-cert\") pod \"81994ee7-7267-4ebc-91cf-6588a4b754f7\" (UID: \"81994ee7-7267-4ebc-91cf-6588a4b754f7\") "
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328551    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328561    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328683    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328759    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328866    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328887    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328901    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.328934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328916    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.329212 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.328948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81994ee7-7267-4ebc-91cf-6588a4b754f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:27:26.330455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.330411    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:27:26.330593 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.330570    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-kube-api-access-dxf4m" (OuterVolumeSpecName: "kube-api-access-dxf4m") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "kube-api-access-dxf4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:27:26.330883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.330860    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:27:26.330883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.330868    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "81994ee7-7267-4ebc-91cf-6588a4b754f7" (UID: "81994ee7-7267-4ebc-91cf-6588a4b754f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:27:26.340856 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.340833    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:26.429734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.429716    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81994ee7-7267-4ebc-91cf-6588a4b754f7-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.429734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.429736    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.429846 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.429744    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxf4m\" (UniqueName: \"kubernetes.io/projected/81994ee7-7267-4ebc-91cf-6588a4b754f7-kube-api-access-dxf4m\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.429846 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.429752    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.429846 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.429761    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81994ee7-7267-4ebc-91cf-6588a4b754f7-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:27:26.786776 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.786741    2557 generic.go:356] "Generic (PLEG): container finished" podID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerID="c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0" exitCode=0
Sep 10 12:27:26.786936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.786806    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"
Sep 10 12:27:26.786936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.786828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" event={"ID":"81994ee7-7267-4ebc-91cf-6588a4b754f7","Type":"ContainerDied","Data":"c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0"}
Sep 10 12:27:26.786936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.786890    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr" event={"ID":"81994ee7-7267-4ebc-91cf-6588a4b754f7","Type":"ContainerDied","Data":"204c917627dd9fd054fc0befeb1cc7fceb0f82bd705ef9e4520855021fd2eab2"}
Sep 10 12:27:26.786936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.786917    2557 scope.go:117] "RemoveContainer" containerID="c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0"
Sep 10 12:27:26.796282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.796262    2557 scope.go:117] "RemoveContainer" containerID="de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"
Sep 10 12:27:26.805812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.805796    2557 scope.go:117] "RemoveContainer" containerID="c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0"
Sep 10 12:27:26.806071 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:27:26.806050    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0\": container with ID starting with c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0 not found: ID does not exist" containerID="c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0"
Sep 10 12:27:26.806132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.806080    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0"} err="failed to get container status \"c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0\": rpc error: code = NotFound desc = could not find container \"c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0\": container with ID starting with c0df6e1f682ebd11511d2fe943a0b5c0da6c075f05e11a15acaa5a00706b2ed0 not found: ID does not exist"
Sep 10 12:27:26.806132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.806096    2557 scope.go:117] "RemoveContainer" containerID="de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"
Sep 10 12:27:26.806346 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:27:26.806324    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944\": container with ID starting with de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944 not found: ID does not exist" containerID="de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"
Sep 10 12:27:26.806395 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.806354    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944"} err="failed to get container status \"de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944\": rpc error: code = NotFound desc = could not find container \"de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944\": container with ID starting with de32e6d7dc5250dbf9b5122a1c2215b57a9ea00c5551b477a04274eb96399944 not found: ID does not exist"
Sep 10 12:27:26.823687 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.823665    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"]
Sep 10 12:27:26.836388 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.836367    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr"]
Sep 10 12:27:26.912416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:26.912393    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:27.042787 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.042721    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:27.110263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110241    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"]
Sep 10 12:27:27.110601 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110587    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy"
Sep 10 12:27:27.110601 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110603    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy"
Sep 10 12:27:27.110670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110622    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy"
Sep 10 12:27:27.110670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110628    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy"
Sep 10 12:27:27.110743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110692    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy"
Sep 10 12:27:27.110743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.110701    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" containerName="istio-proxy"
Sep 10 12:27:27.113638 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.113623    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.117599 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.117582    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-18c2d2-dockercfg-727hp\""
Sep 10 12:27:27.118316 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.118300    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-18c2d2\""
Sep 10 12:27:27.133231 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.133205    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"]
Sep 10 12:27:27.167544 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.167503    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"]
Sep 10 12:27:27.172359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.172325    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.182603 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.182578    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"]
Sep 10 12:27:27.238279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.238256    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202dd0f9-3509-431b-ab58-7323b91f35aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.238401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.238323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv8dc\" (UniqueName: \"kubernetes.io/projected/202dd0f9-3509-431b-ab58-7323b91f35aa-kube-api-access-tv8dc\") pod \"payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.338986 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.338930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8dc\" (UniqueName: \"kubernetes.io/projected/202dd0f9-3509-431b-ab58-7323b91f35aa-kube-api-access-tv8dc\") pod \"payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.338986 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.338982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9f4\" (UniqueName: \"kubernetes.io/projected/a7660833-3eb2-414e-b7f9-36c2d5102e88-kube-api-access-7m9f4\") pod \"payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.339130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.339014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202dd0f9-3509-431b-ab58-7323b91f35aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.339130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.339032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7660833-3eb2-414e-b7f9-36c2d5102e88-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.339654 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.339636    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202dd0f9-3509-431b-ab58-7323b91f35aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.350684 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.350667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv8dc\" (UniqueName: \"kubernetes.io/projected/202dd0f9-3509-431b-ab58-7323b91f35aa-kube-api-access-tv8dc\") pod \"payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.422763 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.422743    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.439962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.439941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7660833-3eb2-414e-b7f9-36c2d5102e88-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.440086 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.440071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9f4\" (UniqueName: \"kubernetes.io/projected/a7660833-3eb2-414e-b7f9-36c2d5102e88-kube-api-access-7m9f4\") pod \"payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.440552 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.440536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7660833-3eb2-414e-b7f9-36c2d5102e88-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.452745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.452716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9f4\" (UniqueName: \"kubernetes.io/projected/a7660833-3eb2-414e-b7f9-36c2d5102e88-kube-api-access-7m9f4\") pod \"payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.485766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.485740    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:27.700708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.700683    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"]
Sep 10 12:27:27.702457 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:27:27.702418    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202dd0f9_3509_431b_ab58_7323b91f35aa.slice/crio-74f427f73dca6032be58d800ccfd50d8d616b840bb02be04ae695de40689fb6f WatchSource:0}: Error finding container 74f427f73dca6032be58d800ccfd50d8d616b840bb02be04ae695de40689fb6f: Status 404 returned error can't find the container with id 74f427f73dca6032be58d800ccfd50d8d616b840bb02be04ae695de40689fb6f
Sep 10 12:27:27.766176 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.766149    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"]
Sep 10 12:27:27.766719 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:27:27.766697    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7660833_3eb2_414e_b7f9_36c2d5102e88.slice/crio-3a6257375e7446bfbf66ad52a42938e17e07b64792669b39de2a618e52089419 WatchSource:0}: Error finding container 3a6257375e7446bfbf66ad52a42938e17e07b64792669b39de2a618e52089419: Status 404 returned error can't find the container with id 3a6257375e7446bfbf66ad52a42938e17e07b64792669b39de2a618e52089419
Sep 10 12:27:27.794722 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.794693    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4" event={"ID":"a7660833-3eb2-414e-b7f9-36c2d5102e88","Type":"ContainerStarted","Data":"3a6257375e7446bfbf66ad52a42938e17e07b64792669b39de2a618e52089419"}
Sep 10 12:27:27.796324 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.796300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj" event={"ID":"202dd0f9-3509-431b-ab58-7323b91f35aa","Type":"ContainerStarted","Data":"38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c"}
Sep 10 12:27:27.796409 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.796342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj" event={"ID":"202dd0f9-3509-431b-ab58-7323b91f35aa","Type":"ContainerStarted","Data":"74f427f73dca6032be58d800ccfd50d8d616b840bb02be04ae695de40689fb6f"}
Sep 10 12:27:27.796512 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.796420    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:27.823523 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:27.823473    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj" podStartSLOduration=0.823459831 podStartE2EDuration="823.459831ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:27:27.821039773 +0000 UTC m=+1061.915220033" watchObservedRunningTime="2026-09-10 12:27:27.823459831 +0000 UTC m=+1061.917640022"
Sep 10 12:27:28.392503 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:28.392467    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81994ee7-7267-4ebc-91cf-6588a4b754f7" path="/var/lib/kubelet/pods/81994ee7-7267-4ebc-91cf-6588a4b754f7/volumes"
Sep 10 12:27:28.805991 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:28.805904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4" event={"ID":"a7660833-3eb2-414e-b7f9-36c2d5102e88","Type":"ContainerStarted","Data":"bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c"}
Sep 10 12:27:28.806209 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:28.806188    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:28.833480 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:28.833416    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4" podStartSLOduration=1.833397712 podStartE2EDuration="1.833397712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:27:28.83082794 +0000 UTC m=+1062.925008130" watchObservedRunningTime="2026-09-10 12:27:28.833397712 +0000 UTC m=+1062.927577908"
Sep 10 12:27:29.710492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:29.710462    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:29.812401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:29.812366    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:30.384630 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:30.384603    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:38.808043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:38.807943    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:27:38.992351 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:38.991771    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:44468->10.133.0.54:15021: read: connection reset by peer" start-of-body=
Sep 10 12:27:38.992351 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:38.991943    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:44468->10.133.0.54:15021: read: connection reset by peer"
Sep 10 12:27:39.870802 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:39.870776    2557 generic.go:356] "Generic (PLEG): container finished" podID="09b28d4f-0847-48ec-acab-561d4d33c162" containerID="fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e" exitCode=0
Sep 10 12:27:39.871147 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:39.870816    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" event={"ID":"09b28d4f-0847-48ec-acab-561d4d33c162","Type":"ContainerDied","Data":"fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"}
Sep 10 12:27:39.871147 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:39.871127    2557 scope.go:117] "RemoveContainer" containerID="fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"
Sep 10 12:27:39.872071 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:39.872035    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:27:39.872221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:39.872117    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:27:39.872221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:39.872148    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:27:40.817131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:40.817100    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:40.819420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:40.819398    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:27:40.886455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:40.886405    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" event={"ID":"09b28d4f-0847-48ec-acab-561d4d33c162","Type":"ContainerStarted","Data":"0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed"}
Sep 10 12:27:40.916151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:40.916118    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:41.043841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:41.043805    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:41.127614 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:41.127569    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:41.262449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:41.253613    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:41.262449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:41.253725    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:27:41.262449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:41.253765    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 12:27:41.475512 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:41.475420    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:42.253328 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:42.253284    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:27:42.253801 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:42.253349    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 12:27:43.253279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:43.252811    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:27:43.253279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:43.252885    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 12:27:44.253028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:44.252991    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:27:44.253296 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:44.253268    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 12:27:45.252995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:45.252959    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 10 12:27:45.253590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:45.253544    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 10 12:27:46.255874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:46.255846    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:46.256220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:46.256108    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:46.256779 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:46.256758    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:27:47.488071 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:47.488039    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:48.411578 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:48.411540    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:48.508855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:48.508820    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:48.669963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:48.669888    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:49.044751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:49.044670    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:49.160590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:49.160561    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:49.266684 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:49.266657    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:49.739123 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:49.739052    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:50.061765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:50.061691    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:50.430576 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:50.430546    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:50.604586 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:50.604547    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:53.138148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:53.138117    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:53.274819 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:53.274790    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:54.425574 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:54.425540    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:54.562836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:54.562805    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:55.132040 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:55.132010    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:55.291402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:55.291369    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:56.746810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:56.746775    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:56.851042 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:56.851005    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:56.948446 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:56.948403    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:27:57.103384 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:27:57.103310    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:03.570297 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:03.570264    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:03.669475 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:03.669449    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:04.450606 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.450576    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:04.730712 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.730642    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"]
Sep 10 12:28:04.735663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.735643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.739454 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.739435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d1e553-openshift-default-dockercfg-q8ktb\""
Sep 10 12:28:04.748346 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.748327    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"]
Sep 10 12:28:04.791179 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.791137    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:04.863111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b5a33e-050a-4273-a075-93277de2ba79-istio-podinfo\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863116    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-credential-socket\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863309 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-socket\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863309 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b5a33e-050a-4273-a075-93277de2ba79-istiod-ca-cert\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863309 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-istio-token\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863315    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-certs\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfrg\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-kube-api-access-crfrg\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-envoy\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.863405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.863380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-data\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964573 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b5a33e-050a-4273-a075-93277de2ba79-istio-podinfo\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-credential-socket\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-socket\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b5a33e-050a-4273-a075-93277de2ba79-istiod-ca-cert\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964694    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-istio-token\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-certs\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964924 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964897    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfrg\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-kube-api-access-crfrg\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.964980 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-envoy\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.965031 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.964980    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-data\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.965031 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.965007    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-credential-socket\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.965135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.965035    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-certs\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.965135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.965096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-socket\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.965310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.965291    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-data\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.965495 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.965475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b5a33e-050a-4273-a075-93277de2ba79-istiod-ca-cert\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.967066 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.967039    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-envoy\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.967159 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.967092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b5a33e-050a-4273-a075-93277de2ba79-istio-podinfo\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.974230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.974210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-istio-token\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:04.974591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:04.974565    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfrg\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-kube-api-access-crfrg\") pod \"e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") " pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:05.045909 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:05.045845    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:05.323693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:05.323666    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"]
Sep 10 12:28:05.324828 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:28:05.324793    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b5a33e_050a_4273_a075_93277de2ba79.slice/crio-ea181e5d735626cb17d3a8cd26c45f47ea4fdf40b5204de65af37e3f87467647 WatchSource:0}: Error finding container ea181e5d735626cb17d3a8cd26c45f47ea4fdf40b5204de65af37e3f87467647: Status 404 returned error can't find the container with id ea181e5d735626cb17d3a8cd26c45f47ea4fdf40b5204de65af37e3f87467647
Sep 10 12:28:05.327279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:05.327248    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:28:05.327378 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:05.327326    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:28:05.327378 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:05.327370    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:28:05.352987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:05.352966    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:06.022778 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.022746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" event={"ID":"47b5a33e-050a-4273-a075-93277de2ba79","Type":"ContainerStarted","Data":"7d1c7298894c0d066948a21e003f2b5bcf6c6f53d7409dca1ae2545aef1dc627"}
Sep 10 12:28:06.023135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.022794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" event={"ID":"47b5a33e-050a-4273-a075-93277de2ba79","Type":"ContainerStarted","Data":"ea181e5d735626cb17d3a8cd26c45f47ea4fdf40b5204de65af37e3f87467647"}
Sep 10 12:28:06.046061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.046012    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podStartSLOduration=2.045997261 podStartE2EDuration="2.045997261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:28:06.043879739 +0000 UTC m=+1100.138059957" watchObservedRunningTime="2026-09-10 12:28:06.045997261 +0000 UTC m=+1100.140177451"
Sep 10 12:28:06.046850 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.046832    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:06.051322 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.051298    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:06.506742 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.506707    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:06.608938 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:06.608910    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:07.028998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:07.028971    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:07.029791 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:07.029775    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:07.940065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:07.940015    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:08.037463 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:08.037422    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:09.258622 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:09.258591    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:09.359766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:09.359739    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:09.461421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:09.461391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:09.924011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:09.923981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:10.021404 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.021377    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:10.173113 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.173067    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"]
Sep 10 12:28:10.177107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.177049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.180421 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.180400    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-d1e553-dockercfg-z7hcw\""
Sep 10 12:28:10.180608 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.180591    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-d1e553\""
Sep 10 12:28:10.190041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.190017    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"]
Sep 10 12:28:10.312933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.312906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75579792-6cb4-410d-9fe6-00e4b7404ba5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.313235 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.312947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj9kz\" (UniqueName: \"kubernetes.io/projected/75579792-6cb4-410d-9fe6-00e4b7404ba5-kube-api-access-fj9kz\") pod \"payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.413963 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.413939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75579792-6cb4-410d-9fe6-00e4b7404ba5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.414072 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.413975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj9kz\" (UniqueName: \"kubernetes.io/projected/75579792-6cb4-410d-9fe6-00e4b7404ba5-kube-api-access-fj9kz\") pod \"payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.414658 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.414635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75579792-6cb4-410d-9fe6-00e4b7404ba5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.424939 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.424917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj9kz\" (UniqueName: \"kubernetes.io/projected/75579792-6cb4-410d-9fe6-00e4b7404ba5-kube-api-access-fj9kz\") pod \"payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.487382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.487325    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:10.762550 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:10.762523    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"]
Sep 10 12:28:10.763314 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:28:10.763291    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75579792_6cb4_410d_9fe6_00e4b7404ba5.slice/crio-5a47ab07d3edc6d16912c3c412522e2969d91e5ce6f9c163e060eb09a9b63a2f WatchSource:0}: Error finding container 5a47ab07d3edc6d16912c3c412522e2969d91e5ce6f9c163e060eb09a9b63a2f: Status 404 returned error can't find the container with id 5a47ab07d3edc6d16912c3c412522e2969d91e5ce6f9c163e060eb09a9b63a2f
Sep 10 12:28:11.051048 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:11.050967    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq" event={"ID":"75579792-6cb4-410d-9fe6-00e4b7404ba5","Type":"ContainerStarted","Data":"3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf"}
Sep 10 12:28:11.051048 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:11.051022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq" event={"ID":"75579792-6cb4-410d-9fe6-00e4b7404ba5","Type":"ContainerStarted","Data":"5a47ab07d3edc6d16912c3c412522e2969d91e5ce6f9c163e060eb09a9b63a2f"}
Sep 10 12:28:11.051267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:11.051084    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:11.072925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:11.072878    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq" podStartSLOduration=1.072866516 podStartE2EDuration="1.072866516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:28:11.071125661 +0000 UTC m=+1105.165305850" watchObservedRunningTime="2026-09-10 12:28:11.072866516 +0000 UTC m=+1105.167046725"
Sep 10 12:28:15.777053 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:15.777014    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:17.999927 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:17.999890    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:21.105365 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:21.105320    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:22.058147 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:22.058116    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:28:22.551197 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:22.551066    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:58316->10.133.0.57:15021: read: connection reset by peer" start-of-body=
Sep 10 12:28:22.551197 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:22.551153    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:58316->10.133.0.57:15021: read: connection reset by peer"
Sep 10 12:28:23.123483 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:23.123455    2557 generic.go:356] "Generic (PLEG): container finished" podID="47b5a33e-050a-4273-a075-93277de2ba79" containerID="7d1c7298894c0d066948a21e003f2b5bcf6c6f53d7409dca1ae2545aef1dc627" exitCode=0
Sep 10 12:28:23.123616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:23.123530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" event={"ID":"47b5a33e-050a-4273-a075-93277de2ba79","Type":"ContainerDied","Data":"7d1c7298894c0d066948a21e003f2b5bcf6c6f53d7409dca1ae2545aef1dc627"}
Sep 10 12:28:23.123950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:23.123935    2557 scope.go:117] "RemoveContainer" containerID="7d1c7298894c0d066948a21e003f2b5bcf6c6f53d7409dca1ae2545aef1dc627"
Sep 10 12:28:23.124948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:23.124925    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:28:23.125006 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:23.124993    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:28:23.125043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:23.125031    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:28:24.140664 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:24.140606    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" event={"ID":"47b5a33e-050a-4273-a075-93277de2ba79","Type":"ContainerStarted","Data":"63eb94416087b93149056de6c0ad783aeff0a5c43892d4f1cfbe17fd845040cd"}
Sep 10 12:28:25.046028 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:25.045993    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:25.046201 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:25.046184    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 12:28:25.046255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:25.046235    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 12:28:26.046623 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:26.046589    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 12:28:26.046998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:26.046653    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 12:28:27.047159 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:27.047127    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 12:28:27.047566 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:27.047193    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 12:28:28.046734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:28.046701    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 12:28:28.046993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:28.046755    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 12:28:29.049700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:29.049665    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:29.050066 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:29.050011    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:29.050663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:29.050646    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:28:30.409473 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:30.409410    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:32.885002 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:32.884971    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:33.202473 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:33.202369    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:33.534738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:33.534664    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:33.795234 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:33.795162    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:36.442074 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:36.442043    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:36.576737 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:36.576694    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:37.643179 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:37.643143    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:37.740683 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:37.740652    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:37.980788 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:37.980705    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:38.350949 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.350868    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:38.449291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.449258    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:28:38.489936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.489910    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"]
Sep 10 12:28:38.493738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.493719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.496194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.496174    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-a08ea2\""
Sep 10 12:28:38.507972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.507942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"]
Sep 10 12:28:38.590663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.590627    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2033b2c3-c88c-4085-8de1-040ecbdc7294-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.590828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.590766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcwdx\" (UniqueName: \"kubernetes.io/projected/2033b2c3-c88c-4085-8de1-040ecbdc7294-kube-api-access-tcwdx\") pod \"payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.691867 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.691835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2033b2c3-c88c-4085-8de1-040ecbdc7294-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.692320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.691911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcwdx\" (UniqueName: \"kubernetes.io/projected/2033b2c3-c88c-4085-8de1-040ecbdc7294-kube-api-access-tcwdx\") pod \"payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.692643 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.692618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2033b2c3-c88c-4085-8de1-040ecbdc7294-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.719905 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.719877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcwdx\" (UniqueName: \"kubernetes.io/projected/2033b2c3-c88c-4085-8de1-040ecbdc7294-kube-api-access-tcwdx\") pod \"payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:38.804896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:38.804867    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:39.081796 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:39.081768    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"]
Sep 10 12:28:39.082868 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:28:39.082842    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2033b2c3_c88c_4085_8de1_040ecbdc7294.slice/crio-a5a537a8826eaa9960817527f734fdec70b7dcdd391b72a7b2440f014408e5d8 WatchSource:0}: Error finding container a5a537a8826eaa9960817527f734fdec70b7dcdd391b72a7b2440f014408e5d8: Status 404 returned error can't find the container with id a5a537a8826eaa9960817527f734fdec70b7dcdd391b72a7b2440f014408e5d8
Sep 10 12:28:39.236989 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:39.236949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s" event={"ID":"2033b2c3-c88c-4085-8de1-040ecbdc7294","Type":"ContainerStarted","Data":"9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a"}
Sep 10 12:28:39.237161 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:39.237053    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s" event={"ID":"2033b2c3-c88c-4085-8de1-040ecbdc7294","Type":"ContainerStarted","Data":"a5a537a8826eaa9960817527f734fdec70b7dcdd391b72a7b2440f014408e5d8"}
Sep 10 12:28:39.237221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:39.237178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:39.261303 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:39.261260    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s" podStartSLOduration=1.261246061 podStartE2EDuration="1.261246061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:28:39.258125073 +0000 UTC m=+1133.352305265" watchObservedRunningTime="2026-09-10 12:28:39.261246061 +0000 UTC m=+1133.355426270"
Sep 10 12:28:50.244994 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:50.244967    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:28:51.875172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:28:51.875143    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:01.357014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:01.356979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:09.097477 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:09.097376    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:14.400166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:14.400133    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:14.833193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:14.833080    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:15.409093 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:15.409060    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:17.634438 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:17.634399    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:17.751281 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:17.751245    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:18.812766 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:18.812736    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:18.901576 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:18.901548    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:19.000999 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.000971    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:19.368193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.368154    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:19.465422 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.465395    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:19.489180 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.489152    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"]
Sep 10 12:29:19.492550 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.492524    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.495898 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.495877    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-156d6252\""
Sep 10 12:29:19.506045 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.506025    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"]
Sep 10 12:29:19.642617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.642523    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xxn\" (UniqueName: \"kubernetes.io/projected/28d9708d-7171-4241-bf9f-af59567e0db4-kube-api-access-g4xxn\") pod \"payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") " pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.642759 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.642664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9708d-7171-4241-bf9f-af59567e0db4-plugins-config-volume\") pod \"payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") " pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.743458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.743418    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9708d-7171-4241-bf9f-af59567e0db4-plugins-config-volume\") pod \"payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") " pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.743612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.743513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xxn\" (UniqueName: \"kubernetes.io/projected/28d9708d-7171-4241-bf9f-af59567e0db4-kube-api-access-g4xxn\") pod \"payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") " pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.744147 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.744128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9708d-7171-4241-bf9f-af59567e0db4-plugins-config-volume\") pod \"payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") " pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.752787 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.752767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xxn\" (UniqueName: \"kubernetes.io/projected/28d9708d-7171-4241-bf9f-af59567e0db4-kube-api-access-g4xxn\") pod \"payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") " pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:19.802709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:19.802690    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:20.078689 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:20.078655    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"]
Sep 10 12:29:20.079166 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:29:20.079143    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d9708d_7171_4241_bf9f_af59567e0db4.slice/crio-e8a54b0f80fb9cb868d62e827f054939f38870930b88999e5dd23bb046d81e6a WatchSource:0}: Error finding container e8a54b0f80fb9cb868d62e827f054939f38870930b88999e5dd23bb046d81e6a: Status 404 returned error can't find the container with id e8a54b0f80fb9cb868d62e827f054939f38870930b88999e5dd23bb046d81e6a
Sep 10 12:29:20.477557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:20.477522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk" event={"ID":"28d9708d-7171-4241-bf9f-af59567e0db4","Type":"ContainerStarted","Data":"0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5"}
Sep 10 12:29:20.477721 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:20.477590    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:20.477721 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:20.477618    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk" event={"ID":"28d9708d-7171-4241-bf9f-af59567e0db4","Type":"ContainerStarted","Data":"e8a54b0f80fb9cb868d62e827f054939f38870930b88999e5dd23bb046d81e6a"}
Sep 10 12:29:20.500518 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:20.500474    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk" podStartSLOduration=1.500459816 podStartE2EDuration="1.500459816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:29:20.497858256 +0000 UTC m=+1174.592038459" watchObservedRunningTime="2026-09-10 12:29:20.500459816 +0000 UTC m=+1174.594640006"
Sep 10 12:29:24.923655 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:24.923619    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:31.485331 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:31.485299    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:29:39.851331 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:39.851292    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:42.450855 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:42.450823    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:46.489859 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:46.489829    2557 scope.go:117] "RemoveContainer" containerID="1da05b594be2cb997bb4cb8cfe96dc2d15396b8866ef4bbc5e39d6c718423865"
Sep 10 12:29:49.550410 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:49.550371    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:29:57.741292 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:29:57.741257    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:00.165667 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.165636    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"]
Sep 10 12:30:00.170563 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.170545    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"
Sep 10 12:30:00.176725 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.176702    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"]
Sep 10 12:30:00.177765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.177743    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:30:00.180256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.180237    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"
Sep 10 12:30:00.180652 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.180635    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"
Sep 10 12:30:00.189002 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.188968    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"
Sep 10 12:30:00.192139 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.191689    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"]
Sep 10 12:30:00.204900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.202916    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"]
Sep 10 12:30:00.217825 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.216513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"
Sep 10 12:30:00.224569 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.218025    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"]
Sep 10 12:30:00.227411 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.227295    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"]
Sep 10 12:30:00.251827 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.251567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"
Sep 10 12:30:00.475784 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.475758    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"]
Sep 10 12:30:00.476202 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:30:00.476181    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176f64b3_b78d_4e20_b32f_161465cc887c.slice/crio-204c4f2dc3d8fca316a6b65eb6cfa9430ff855e9afe6adf46e87ee3b989cfe74 WatchSource:0}: Error finding container 204c4f2dc3d8fca316a6b65eb6cfa9430ff855e9afe6adf46e87ee3b989cfe74: Status 404 returned error can't find the container with id 204c4f2dc3d8fca316a6b65eb6cfa9430ff855e9afe6adf46e87ee3b989cfe74
Sep 10 12:30:00.511056 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.511030    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"]
Sep 10 12:30:00.511859 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:30:00.511839    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3830e5b7_1633_4a7c_bf79_d3902c078762.slice/crio-a74eaef1099d3f8adcfe1452429dbcde58b322f13521e230cd454c0280e196b7 WatchSource:0}: Error finding container a74eaef1099d3f8adcfe1452429dbcde58b322f13521e230cd454c0280e196b7: Status 404 returned error can't find the container with id a74eaef1099d3f8adcfe1452429dbcde58b322f13521e230cd454c0280e196b7
Sep 10 12:30:00.547729 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.547707    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"]
Sep 10 12:30:00.548477 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:30:00.548451    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f981041_80dc_4054_b84a_e41d4741e762.slice/crio-963d49facdf173a672be764d864d2a67c7c70eeada04857e7d1952f039fd33cf WatchSource:0}: Error finding container 963d49facdf173a672be764d864d2a67c7c70eeada04857e7d1952f039fd33cf: Status 404 returned error can't find the container with id 963d49facdf173a672be764d864d2a67c7c70eeada04857e7d1952f039fd33cf
Sep 10 12:30:00.707245 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.707218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc" event={"ID":"3830e5b7-1633-4a7c-bf79-d3902c078762","Type":"ContainerStarted","Data":"a74eaef1099d3f8adcfe1452429dbcde58b322f13521e230cd454c0280e196b7"}
Sep 10 12:30:00.708357 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.708330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz" event={"ID":"1f981041-80dc-4054-b84a-e41d4741e762","Type":"ContainerStarted","Data":"963d49facdf173a672be764d864d2a67c7c70eeada04857e7d1952f039fd33cf"}
Sep 10 12:30:00.709479 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:00.709458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv" event={"ID":"176f64b3-b78d-4e20-b32f-161465cc887c","Type":"ContainerStarted","Data":"204c4f2dc3d8fca316a6b65eb6cfa9430ff855e9afe6adf46e87ee3b989cfe74"}
Sep 10 12:30:01.716204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:01.716180    2557 generic.go:356] "Generic (PLEG): container finished" podID="176f64b3-b78d-4e20-b32f-161465cc887c" containerID="21b07e154c67b7e0c233c05adf8dd7f658910e0b271fcd61c85161f8a6dff865" exitCode=0
Sep 10 12:30:01.716549 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:01.716262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv" event={"ID":"176f64b3-b78d-4e20-b32f-161465cc887c","Type":"ContainerDied","Data":"21b07e154c67b7e0c233c05adf8dd7f658910e0b271fcd61c85161f8a6dff865"}
Sep 10 12:30:01.717771 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:01.717751    2557 generic.go:356] "Generic (PLEG): container finished" podID="3830e5b7-1633-4a7c-bf79-d3902c078762" containerID="d92f29c4cc2f85ec630139abe65f462f7bf55b2b6d0d1277133b5447228f5618" exitCode=0
Sep 10 12:30:01.717876 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:01.717833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc" event={"ID":"3830e5b7-1633-4a7c-bf79-d3902c078762","Type":"ContainerDied","Data":"d92f29c4cc2f85ec630139abe65f462f7bf55b2b6d0d1277133b5447228f5618"}
Sep 10 12:30:01.719296 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:01.719276    2557 generic.go:356] "Generic (PLEG): container finished" podID="1f981041-80dc-4054-b84a-e41d4741e762" containerID="4b83a91242673e57b0755d7938b4ff518a4758bee9dfc93eeb5ba8854cc6484f" exitCode=0
Sep 10 12:30:01.719416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:01.719343    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz" event={"ID":"1f981041-80dc-4054-b84a-e41d4741e762","Type":"ContainerDied","Data":"4b83a91242673e57b0755d7938b4ff518a4758bee9dfc93eeb5ba8854cc6484f"}
Sep 10 12:30:02.871710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:02.871682    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"
Sep 10 12:30:02.904409 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:02.904386    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"
Sep 10 12:30:02.907697 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:02.907681    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"
Sep 10 12:30:03.220045 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.220011    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:03.734890 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.734862    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"
Sep 10 12:30:03.734890 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.734880    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv" event={"ID":"176f64b3-b78d-4e20-b32f-161465cc887c","Type":"ContainerDied","Data":"204c4f2dc3d8fca316a6b65eb6cfa9430ff855e9afe6adf46e87ee3b989cfe74"}
Sep 10 12:30:03.735140 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.734928    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="204c4f2dc3d8fca316a6b65eb6cfa9430ff855e9afe6adf46e87ee3b989cfe74"
Sep 10 12:30:03.736276 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.736255    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"
Sep 10 12:30:03.736390 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.736275    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc" event={"ID":"3830e5b7-1633-4a7c-bf79-d3902c078762","Type":"ContainerDied","Data":"a74eaef1099d3f8adcfe1452429dbcde58b322f13521e230cd454c0280e196b7"}
Sep 10 12:30:03.736390 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.736316    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a74eaef1099d3f8adcfe1452429dbcde58b322f13521e230cd454c0280e196b7"
Sep 10 12:30:03.737585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.737571    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz"
Sep 10 12:30:03.737674 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.737569    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817390-qh9dz" event={"ID":"1f981041-80dc-4054-b84a-e41d4741e762","Type":"ContainerDied","Data":"963d49facdf173a672be764d864d2a67c7c70eeada04857e7d1952f039fd33cf"}
Sep 10 12:30:03.737731 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:03.737693    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="963d49facdf173a672be764d864d2a67c7c70eeada04857e7d1952f039fd33cf"
Sep 10 12:30:26.701591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.701561    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"]
Sep 10 12:30:26.702041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702021    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176f64b3-b78d-4e20-b32f-161465cc887c" containerName="cleanup"
Sep 10 12:30:26.702041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702037    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="176f64b3-b78d-4e20-b32f-161465cc887c" containerName="cleanup"
Sep 10 12:30:26.702130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702052    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3830e5b7-1633-4a7c-bf79-d3902c078762" containerName="cleanup"
Sep 10 12:30:26.702130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702058    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3830e5b7-1633-4a7c-bf79-d3902c078762" containerName="cleanup"
Sep 10 12:30:26.702130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702064    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f981041-80dc-4054-b84a-e41d4741e762" containerName="cleanup"
Sep 10 12:30:26.702130 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702070    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f981041-80dc-4054-b84a-e41d4741e762" containerName="cleanup"
Sep 10 12:30:26.702288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702148    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3830e5b7-1633-4a7c-bf79-d3902c078762" containerName="cleanup"
Sep 10 12:30:26.702288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702160    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f981041-80dc-4054-b84a-e41d4741e762" containerName="cleanup"
Sep 10 12:30:26.702288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.702166    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="176f64b3-b78d-4e20-b32f-161465cc887c" containerName="cleanup"
Sep 10 12:30:26.705461 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.705410    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:26.708398 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.708378    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:30:26.708531 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.708461    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:30:26.718313 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.718286    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"]
Sep 10 12:30:26.886661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.886632    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d476e70-e458-48c5-a961-33686303f975-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-156d6252-hdfw2\" (UID: \"3d476e70-e458-48c5-a961-33686303f975\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:26.987893 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.987808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d476e70-e458-48c5-a961-33686303f975-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-156d6252-hdfw2\" (UID: \"3d476e70-e458-48c5-a961-33686303f975\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:26.988373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:26.988353    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d476e70-e458-48c5-a961-33686303f975-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-156d6252-hdfw2\" (UID: \"3d476e70-e458-48c5-a961-33686303f975\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:27.017888 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:27.017869    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:27.288992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:27.288970    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"]
Sep 10 12:30:27.290290 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:30:27.290262    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d476e70_e458_48c5_a961_33686303f975.slice/crio-45ffa158e90cc0fc291a22cdd5e92514365423e330837d14aad92d76bcfb1a46 WatchSource:0}: Error finding container 45ffa158e90cc0fc291a22cdd5e92514365423e330837d14aad92d76bcfb1a46: Status 404 returned error can't find the container with id 45ffa158e90cc0fc291a22cdd5e92514365423e330837d14aad92d76bcfb1a46
Sep 10 12:30:27.876000 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:27.875975    2557 generic.go:356] "Generic (PLEG): container finished" podID="3d476e70-e458-48c5-a961-33686303f975" containerID="8fc36821239487a7384603c2e04a118a389fc7ab5da8b53d72a5bfca6722ef3e" exitCode=0
Sep 10 12:30:27.876272 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:27.876053    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2" event={"ID":"3d476e70-e458-48c5-a961-33686303f975","Type":"ContainerDied","Data":"8fc36821239487a7384603c2e04a118a389fc7ab5da8b53d72a5bfca6722ef3e"}
Sep 10 12:30:27.876272 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:27.876104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2" event={"ID":"3d476e70-e458-48c5-a961-33686303f975","Type":"ContainerStarted","Data":"45ffa158e90cc0fc291a22cdd5e92514365423e330837d14aad92d76bcfb1a46"}
Sep 10 12:30:29.008318 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.008294    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:29.105107 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.105084    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d476e70-e458-48c5-a961-33686303f975-maas-api-service-ca\") pod \"3d476e70-e458-48c5-a961-33686303f975\" (UID: \"3d476e70-e458-48c5-a961-33686303f975\") "
Sep 10 12:30:29.105384 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.105364    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d476e70-e458-48c5-a961-33686303f975-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d476e70-e458-48c5-a961-33686303f975" (UID: "3d476e70-e458-48c5-a961-33686303f975"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:30:29.205957 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.205897    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d476e70-e458-48c5-a961-33686303f975-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:30:29.890287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.890257    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"
Sep 10 12:30:29.890287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.890277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2" event={"ID":"3d476e70-e458-48c5-a961-33686303f975","Type":"ContainerDied","Data":"45ffa158e90cc0fc291a22cdd5e92514365423e330837d14aad92d76bcfb1a46"}
Sep 10 12:30:29.890499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:29.890315    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45ffa158e90cc0fc291a22cdd5e92514365423e330837d14aad92d76bcfb1a46"
Sep 10 12:30:42.351973 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.351894    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"]
Sep 10 12:30:42.352486 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.352125    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk" podUID="28d9708d-7171-4241-bf9f-af59567e0db4" containerName="payload-processing" containerID="cri-o://0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5" gracePeriod=30
Sep 10 12:30:42.416947 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.416918    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:42.513565 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.513531    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:42.605995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.605925    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:30:42.607158 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.607133    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"]
Sep 10 12:30:42.608111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.608088    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:42.609746 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.609727    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-156d6252-hdfw2"]
Sep 10 12:30:42.698590 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.698549    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:42.713825 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.713791    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4xxn\" (UniqueName: \"kubernetes.io/projected/28d9708d-7171-4241-bf9f-af59567e0db4-kube-api-access-g4xxn\") pod \"28d9708d-7171-4241-bf9f-af59567e0db4\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") "
Sep 10 12:30:42.713972 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.713876    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9708d-7171-4241-bf9f-af59567e0db4-plugins-config-volume\") pod \"28d9708d-7171-4241-bf9f-af59567e0db4\" (UID: \"28d9708d-7171-4241-bf9f-af59567e0db4\") "
Sep 10 12:30:42.714199 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.714165    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28d9708d-7171-4241-bf9f-af59567e0db4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28d9708d-7171-4241-bf9f-af59567e0db4" (UID: "28d9708d-7171-4241-bf9f-af59567e0db4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:30:42.715955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.715932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28d9708d-7171-4241-bf9f-af59567e0db4-kube-api-access-g4xxn" (OuterVolumeSpecName: "kube-api-access-g4xxn") pod "28d9708d-7171-4241-bf9f-af59567e0db4" (UID: "28d9708d-7171-4241-bf9f-af59567e0db4"). InnerVolumeSpecName "kube-api-access-g4xxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:30:42.814510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.814487    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4xxn\" (UniqueName: \"kubernetes.io/projected/28d9708d-7171-4241-bf9f-af59567e0db4-kube-api-access-g4xxn\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:30:42.814510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.814510    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d9708d-7171-4241-bf9f-af59567e0db4-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:30:42.967108 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.967071    2557 generic.go:356] "Generic (PLEG): container finished" podID="28d9708d-7171-4241-bf9f-af59567e0db4" containerID="0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5" exitCode=0
Sep 10 12:30:42.967291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.967125    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"
Sep 10 12:30:42.967291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.967135    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk" event={"ID":"28d9708d-7171-4241-bf9f-af59567e0db4","Type":"ContainerDied","Data":"0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5"}
Sep 10 12:30:42.967291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.967176    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk" event={"ID":"28d9708d-7171-4241-bf9f-af59567e0db4","Type":"ContainerDied","Data":"e8a54b0f80fb9cb868d62e827f054939f38870930b88999e5dd23bb046d81e6a"}
Sep 10 12:30:42.967291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.967198    2557 scope.go:117] "RemoveContainer" containerID="0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5"
Sep 10 12:30:42.976341 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.976328    2557 scope.go:117] "RemoveContainer" containerID="0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5"
Sep 10 12:30:42.976627 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:30:42.976603    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5\": container with ID starting with 0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5 not found: ID does not exist" containerID="0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5"
Sep 10 12:30:42.976724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.976635    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5"} err="failed to get container status \"0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5\": rpc error: code = NotFound desc = could not find container \"0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5\": container with ID starting with 0e82ed5343d4deb0388ead384860a2251b48372a18b7022a9450d4633801fab5 not found: ID does not exist"
Sep 10 12:30:42.999400 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:42.999373    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"]
Sep 10 12:30:43.007681 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:43.007662    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk"]
Sep 10 12:30:44.389735 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:44.389703    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28d9708d-7171-4241-bf9f-af59567e0db4" path="/var/lib/kubelet/pods/28d9708d-7171-4241-bf9f-af59567e0db4/volumes"
Sep 10 12:30:44.390101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:44.390058    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d476e70-e458-48c5-a961-33686303f975" path="/var/lib/kubelet/pods/3d476e70-e458-48c5-a961-33686303f975/volumes"
Sep 10 12:30:45.642064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:45.642036    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:30:46.512789 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:46.512760    2557 scope.go:117] "RemoveContainer" containerID="adb12bc30f6921a3900d0be6a086b4786e8a8f302aed51248c50b6fcc66b40a2"
Sep 10 12:30:50.747022 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:30:50.746979    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:05.203520 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.203488    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7600-622177"]
Sep 10 12:31:05.203911 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.203897    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d9708d-7171-4241-bf9f-af59567e0db4" containerName="payload-processing"
Sep 10 12:31:05.203957 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.203913    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d9708d-7171-4241-bf9f-af59567e0db4" containerName="payload-processing"
Sep 10 12:31:05.203957 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.203926    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d476e70-e458-48c5-a961-33686303f975" containerName="revoke-keys"
Sep 10 12:31:05.203957 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.203933    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d476e70-e458-48c5-a961-33686303f975" containerName="revoke-keys"
Sep 10 12:31:05.204052 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.204005    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d476e70-e458-48c5-a961-33686303f975" containerName="revoke-keys"
Sep 10 12:31:05.204052 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.204014    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d9708d-7171-4241-bf9f-af59567e0db4" containerName="payload-processing"
Sep 10 12:31:05.208443 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.208412    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:05.211449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.211410    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-grlsn\""
Sep 10 12:31:05.214402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.214378    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7600-622177"]
Sep 10 12:31:05.304221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.304195    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhhsj\" (UniqueName: \"kubernetes.io/projected/d7a2a71f-2d33-4cf6-8fad-acf15d562476-kube-api-access-lhhsj\") pod \"mt-curl-7600-622177\" (UID: \"d7a2a71f-2d33-4cf6-8fad-acf15d562476\") " pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:05.405461 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.405412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhhsj\" (UniqueName: \"kubernetes.io/projected/d7a2a71f-2d33-4cf6-8fad-acf15d562476-kube-api-access-lhhsj\") pod \"mt-curl-7600-622177\" (UID: \"d7a2a71f-2d33-4cf6-8fad-acf15d562476\") " pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:05.414561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.414536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhhsj\" (UniqueName: \"kubernetes.io/projected/d7a2a71f-2d33-4cf6-8fad-acf15d562476-kube-api-access-lhhsj\") pod \"mt-curl-7600-622177\" (UID: \"d7a2a71f-2d33-4cf6-8fad-acf15d562476\") " pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:05.519734 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.519674    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:05.793053 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.792983    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7600-622177"]
Sep 10 12:31:05.796396 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:31:05.796369    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7a2a71f_2d33_4cf6_8fad_acf15d562476.slice/crio-5bd9f2e3eed12324b5738167831384644c1a88cc5c74bedead2cb6bc2f065f05 WatchSource:0}: Error finding container 5bd9f2e3eed12324b5738167831384644c1a88cc5c74bedead2cb6bc2f065f05: Status 404 returned error can't find the container with id 5bd9f2e3eed12324b5738167831384644c1a88cc5c74bedead2cb6bc2f065f05
Sep 10 12:31:05.797575 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:05.797555    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:31:06.100316 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:06.100239    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7600-622177" event={"ID":"d7a2a71f-2d33-4cf6-8fad-acf15d562476","Type":"ContainerStarted","Data":"5bd9f2e3eed12324b5738167831384644c1a88cc5c74bedead2cb6bc2f065f05"}
Sep 10 12:31:07.107004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:07.106970    2557 generic.go:356] "Generic (PLEG): container finished" podID="d7a2a71f-2d33-4cf6-8fad-acf15d562476" containerID="2d363dc5c6c374768d7216d460bac40b0383522557c5af13ff6182eb8fc6b945" exitCode=0
Sep 10 12:31:07.107333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:07.107056    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7600-622177" event={"ID":"d7a2a71f-2d33-4cf6-8fad-acf15d562476","Type":"ContainerDied","Data":"2d363dc5c6c374768d7216d460bac40b0383522557c5af13ff6182eb8fc6b945"}
Sep 10 12:31:08.247066 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.247045    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:08.283568 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.280058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7600-622177_d7a2a71f-2d33-4cf6-8fad-acf15d562476/mt-curl-7600-622177/0.log"
Sep 10 12:31:08.308501 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.308475    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7600-622177"]
Sep 10 12:31:08.317209 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.317187    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7600-622177"]
Sep 10 12:31:08.329997 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.329981    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhhsj\" (UniqueName: \"kubernetes.io/projected/d7a2a71f-2d33-4cf6-8fad-acf15d562476-kube-api-access-lhhsj\") pod \"d7a2a71f-2d33-4cf6-8fad-acf15d562476\" (UID: \"d7a2a71f-2d33-4cf6-8fad-acf15d562476\") "
Sep 10 12:31:08.332029 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.332005    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a2a71f-2d33-4cf6-8fad-acf15d562476-kube-api-access-lhhsj" (OuterVolumeSpecName: "kube-api-access-lhhsj") pod "d7a2a71f-2d33-4cf6-8fad-acf15d562476" (UID: "d7a2a71f-2d33-4cf6-8fad-acf15d562476"). InnerVolumeSpecName "kube-api-access-lhhsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:31:08.390729 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.390675    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a2a71f-2d33-4cf6-8fad-acf15d562476" path="/var/lib/kubelet/pods/d7a2a71f-2d33-4cf6-8fad-acf15d562476/volumes"
Sep 10 12:31:08.430708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:08.430685    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhhsj\" (UniqueName: \"kubernetes.io/projected/d7a2a71f-2d33-4cf6-8fad-acf15d562476-kube-api-access-lhhsj\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:31:09.118733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:09.118710    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7600-622177"
Sep 10 12:31:09.118885 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:09.118764    2557 scope.go:117] "RemoveContainer" containerID="2d363dc5c6c374768d7216d460bac40b0383522557c5af13ff6182eb8fc6b945"
Sep 10 12:31:09.800388 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:09.800358    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:10.828899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:10.828866    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:15.252489 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:15.252451    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:15.351287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:15.351257    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:22.742927 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:22.742893    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:27.968089 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:27.968057    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:28.487820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:28.487789    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:34.358301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:34.358265    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:34.458346 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:34.458313    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:34.680554 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:34.680452    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:35.910297 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:35.910260    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:36.009727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:36.009701    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:36.669641 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:36.669606    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:36.854610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:36.854581    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:36.954977 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:36.954911    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:38.096739 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:38.096698    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:44.807765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:44.807699    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:44.891154 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:44.891123    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:45.491915 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:45.491886    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:52.066445 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:52.066394    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:52.182791 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:52.182761    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:52.305632 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:52.305602    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:31:59.549393 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:31:59.549349    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:02.791337 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:02.791306    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:03.075873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:03.075808    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:23.959196 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:23.959167    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:31.092456 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.092409    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:31.187175 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.187147    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:31.432777 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.432746    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:31.711708 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.711602    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"]
Sep 10 12:32:31.712091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.712074    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a2a71f-2d33-4cf6-8fad-acf15d562476" containerName="mt-curl-7600-622177"
Sep 10 12:32:31.712091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.712092    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a2a71f-2d33-4cf6-8fad-acf15d562476" containerName="mt-curl-7600-622177"
Sep 10 12:32:31.712195 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.712169    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a2a71f-2d33-4cf6-8fad-acf15d562476" containerName="mt-curl-7600-622177"
Sep 10 12:32:31.715382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.715363    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.718396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.718376    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5ff68c-openshift-default-dockercfg-mhh9c\""
Sep 10 12:32:31.740900 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.740869    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"]
Sep 10 12:32:31.790158 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.790130    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:31.891832 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.891793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-podinfo\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.892091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.892071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-credential-socket\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.892273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.892257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-envoy\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.892621 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.892603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-data\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.892768 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.892751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istiod-ca-cert\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.892893 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.892877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-socket\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.893017 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.893001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9qj\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-kube-api-access-kk9qj\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.893241 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.893226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-certs\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.893381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.893367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-token\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.994810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.994729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-certs\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.994810 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.994774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-token\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.994812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-podinfo\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.994845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-credential-socket\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.994872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-envoy\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995027 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.994893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-data\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995167    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-certs\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995204    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-data\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istiod-ca-cert\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995263 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995258    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-credential-socket\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995547 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995281    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-socket\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995547 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9qj\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-kube-api-access-kk9qj\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995649 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-socket\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.995707 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.995684    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istiod-ca-cert\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.997105 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.997083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-envoy\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:31.997220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:31.997203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-podinfo\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:32.019693 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.019670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-token\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:32.020315 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.020297    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9qj\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-kube-api-access-kk9qj\") pod \"e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") " pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:32.025170 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.025145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:32.114287 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.114261    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:32.306256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.306235    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"]
Sep 10 12:32:32.308582 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:32:32.308554    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f05b757_fd59_4f44_b0f9_d8ea6685a50c.slice/crio-5600169998ecc02fe83ac5ea47b31752b459ddc59185e935cf5cd2464b889f12 WatchSource:0}: Error finding container 5600169998ecc02fe83ac5ea47b31752b459ddc59185e935cf5cd2464b889f12: Status 404 returned error can't find the container with id 5600169998ecc02fe83ac5ea47b31752b459ddc59185e935cf5cd2464b889f12
Sep 10 12:32:32.310581 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.310529    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:32:32.310650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.310614    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:32:32.310650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.310638    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:32:32.586218 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.586132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" event={"ID":"4f05b757-fd59-4f44-b0f9-d8ea6685a50c","Type":"ContainerStarted","Data":"80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"}
Sep 10 12:32:32.586218 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.586186    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" event={"ID":"4f05b757-fd59-4f44-b0f9-d8ea6685a50c","Type":"ContainerStarted","Data":"5600169998ecc02fe83ac5ea47b31752b459ddc59185e935cf5cd2464b889f12"}
Sep 10 12:32:32.612440 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:32.612384    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podStartSLOduration=1.612369802 podStartE2EDuration="1.612369802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:32:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:32.611226256 +0000 UTC m=+1366.705406446" watchObservedRunningTime="2026-09-10 12:32:32.612369802 +0000 UTC m=+1366.706549993"
Sep 10 12:32:33.026134 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:33.026102    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:33.030954 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:33.030929    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:33.592006 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:33.591978    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:33.592788 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:33.592763    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:34.598444 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:34.598397    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:34.704297 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:34.704270    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:35.829633 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:35.829604    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:35.930723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:35.930687    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:36.101557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.101483    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:36.542447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.542403    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:36.655787 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.655761    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:36.832046 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.831955    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"]
Sep 10 12:32:36.837188 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.837154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:36.837803 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.837774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f62c2f-701b-4448-a52d-f6f85d3db2ff-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") " pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:36.838065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.838022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hfc\" (UniqueName: \"kubernetes.io/projected/30f62c2f-701b-4448-a52d-f6f85d3db2ff-kube-api-access-42hfc\") pod \"payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") " pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:36.842350 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.842330    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-5ff68c-dockercfg-pslwd\""
Sep 10 12:32:36.842468 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.842439    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-5ff68c\""
Sep 10 12:32:36.851018 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.850997    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"]
Sep 10 12:32:36.938984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.938959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hfc\" (UniqueName: \"kubernetes.io/projected/30f62c2f-701b-4448-a52d-f6f85d3db2ff-kube-api-access-42hfc\") pod \"payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") " pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:36.939135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.939043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f62c2f-701b-4448-a52d-f6f85d3db2ff-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") " pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:36.939779 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.939762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f62c2f-701b-4448-a52d-f6f85d3db2ff-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") " pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:36.947458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:36.947421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hfc\" (UniqueName: \"kubernetes.io/projected/30f62c2f-701b-4448-a52d-f6f85d3db2ff-kube-api-access-42hfc\") pod \"payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") " pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:37.148090 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:37.148067    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:37.430090 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:37.430063    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"]
Sep 10 12:32:37.431025 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:32:37.430999    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f62c2f_701b_4448_a52d_f6f85d3db2ff.slice/crio-9c7ca80ef54bd1c0239137f598a7e6edf2d8e079c60b28c82c5688b243a0a6fc WatchSource:0}: Error finding container 9c7ca80ef54bd1c0239137f598a7e6edf2d8e079c60b28c82c5688b243a0a6fc: Status 404 returned error can't find the container with id 9c7ca80ef54bd1c0239137f598a7e6edf2d8e079c60b28c82c5688b243a0a6fc
Sep 10 12:32:37.617596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:37.617562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm" event={"ID":"30f62c2f-701b-4448-a52d-f6f85d3db2ff","Type":"ContainerStarted","Data":"5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262"}
Sep 10 12:32:37.617780 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:37.617622    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm" event={"ID":"30f62c2f-701b-4448-a52d-f6f85d3db2ff","Type":"ContainerStarted","Data":"9c7ca80ef54bd1c0239137f598a7e6edf2d8e079c60b28c82c5688b243a0a6fc"}
Sep 10 12:32:37.617780 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:37.617760    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:37.640127 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:37.640085    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm" podStartSLOduration=1.640072971 podStartE2EDuration="1.640072971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:32:37.639114905 +0000 UTC m=+1371.733295096" watchObservedRunningTime="2026-09-10 12:32:37.640072971 +0000 UTC m=+1371.734253161"
Sep 10 12:32:46.552176 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:46.552144    2557 scope.go:117] "RemoveContainer" containerID="e8784b2b156a8c399af1f373e87031ba5523327e75dc471c6c872d61b06c3925"
Sep 10 12:32:48.534756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:48.534723    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:48.626626 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:48.626591    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:32:49.633593 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:49.633551    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 12:32:49.634036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:49.633624    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 12:32:50.319693 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:32:50.319665    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@9-18993-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f05b757_fd59_4f44_b0f9_d8ea6685a50c.slice/crio-80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 12:32:50.705305 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:50.705281    2557 generic.go:356] "Generic (PLEG): container finished" podID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerID="80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92" exitCode=0
Sep 10 12:32:50.705642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:50.705354    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" event={"ID":"4f05b757-fd59-4f44-b0f9-d8ea6685a50c","Type":"ContainerDied","Data":"80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"}
Sep 10 12:32:50.705754 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:50.705740    2557 scope.go:117] "RemoveContainer" containerID="80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"
Sep 10 12:32:50.706772 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:50.706740    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:32:50.706841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:50.706831    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:32:50.706874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:50.706862    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:32:51.713521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:51.713489    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" event={"ID":"4f05b757-fd59-4f44-b0f9-d8ea6685a50c","Type":"ContainerStarted","Data":"f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70"}
Sep 10 12:32:52.025546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:52.025464    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:52.025702 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:52.025679    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 12:32:52.025751 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:52.025732    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 12:32:53.001529 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:53.001486    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:53.026330 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:53.026297    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 12:32:53.026490 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:53.026360    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 12:32:53.780184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:53.780148    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:54.025799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:54.025765    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 12:32:54.026192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:54.025828    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 12:32:55.025975 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:55.025939    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 12:32:55.026411 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:55.025997    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 12:32:56.025716 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:56.025685    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 10 12:32:56.025886 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:56.025749    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 10 12:32:57.013011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:57.012980    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:57.029001 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:57.028976    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:57.029242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:57.029208    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:57.029785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:57.029768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:32:59.503326 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:59.503294    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:32:59.949871 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:32:59.949842    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:00.290156 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:00.290079    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:00.874860 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:00.874827    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:03.748306 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:03.748262    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:03.831581 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:03.831554    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:05.109604 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.109573    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:05.207622 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.207587    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:05.635720 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.635688    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:05.732615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.732586    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:05.766176 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.766149    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"]
Sep 10 12:33:05.769672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.769656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:05.772923 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.772907    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-da7b8f-dockercfg-vfhw7\""
Sep 10 12:33:05.773144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.773130    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-da7b8f\""
Sep 10 12:33:05.787212 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.787193    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"]
Sep 10 12:33:05.833781 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.833754    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"]
Sep 10 12:33:05.837369 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.837354    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:05.850813 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.850786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"]
Sep 10 12:33:05.898761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.898668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thqjt\" (UniqueName: \"kubernetes.io/projected/640e5889-2629-41cf-a37c-13f6e6445dab-kube-api-access-thqjt\") pod \"payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") " pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:05.899071 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.899031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640e5889-2629-41cf-a37c-13f6e6445dab-plugins-config-volume\") pod \"payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") " pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:05.899329 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.899307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:05.899520 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:05.899501    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjwdh\" (UniqueName: \"kubernetes.io/projected/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-kube-api-access-jjwdh\") pod \"payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.000695 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.000666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.000833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.000701    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjwdh\" (UniqueName: \"kubernetes.io/projected/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-kube-api-access-jjwdh\") pod \"payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.000833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.000770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqjt\" (UniqueName: \"kubernetes.io/projected/640e5889-2629-41cf-a37c-13f6e6445dab-kube-api-access-thqjt\") pod \"payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") " pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:06.000833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.000788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640e5889-2629-41cf-a37c-13f6e6445dab-plugins-config-volume\") pod \"payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") " pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:06.001402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.001383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.001462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.001390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640e5889-2629-41cf-a37c-13f6e6445dab-plugins-config-volume\") pod \"payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") " pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:06.010221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.010194    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thqjt\" (UniqueName: \"kubernetes.io/projected/640e5889-2629-41cf-a37c-13f6e6445dab-kube-api-access-thqjt\") pod \"payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") " pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:06.010329 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.010307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjwdh\" (UniqueName: \"kubernetes.io/projected/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-kube-api-access-jjwdh\") pod \"payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.079476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.079453    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:06.146899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.146871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.351329 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.351305    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"]
Sep 10 12:33:06.352474 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:33:06.352450    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640e5889_2629_41cf_a37c_13f6e6445dab.slice/crio-4bd0ba0baa9a664b05d0bedb400ba20d65aac03833f6b680ab6a0b1786bf0955 WatchSource:0}: Error finding container 4bd0ba0baa9a664b05d0bedb400ba20d65aac03833f6b680ab6a0b1786bf0955: Status 404 returned error can't find the container with id 4bd0ba0baa9a664b05d0bedb400ba20d65aac03833f6b680ab6a0b1786bf0955
Sep 10 12:33:06.422976 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.422956    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"]
Sep 10 12:33:06.423589 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:33:06.423567    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32f9f18_da5e_458b_aef5_4d9eba17ef8a.slice/crio-48d3f3733b4d1ab67bc470d06d57162a4b59156967106a7914f9c8efe2a36c12 WatchSource:0}: Error finding container 48d3f3733b4d1ab67bc470d06d57162a4b59156967106a7914f9c8efe2a36c12: Status 404 returned error can't find the container with id 48d3f3733b4d1ab67bc470d06d57162a4b59156967106a7914f9c8efe2a36c12
Sep 10 12:33:06.801458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.801358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2" event={"ID":"d32f9f18-da5e-458b-aef5-4d9eba17ef8a","Type":"ContainerStarted","Data":"32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a"}
Sep 10 12:33:06.801458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.801420    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2" event={"ID":"d32f9f18-da5e-458b-aef5-4d9eba17ef8a","Type":"ContainerStarted","Data":"48d3f3733b4d1ab67bc470d06d57162a4b59156967106a7914f9c8efe2a36c12"}
Sep 10 12:33:06.801673 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.801553    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:06.802946 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.802924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm" event={"ID":"640e5889-2629-41cf-a37c-13f6e6445dab","Type":"ContainerStarted","Data":"7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33"}
Sep 10 12:33:06.803064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.802959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm" event={"ID":"640e5889-2629-41cf-a37c-13f6e6445dab","Type":"ContainerStarted","Data":"4bd0ba0baa9a664b05d0bedb400ba20d65aac03833f6b680ab6a0b1786bf0955"}
Sep 10 12:33:06.803064 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.802979    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:06.821467 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.821412    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2" podStartSLOduration=1.821401978 podStartE2EDuration="1.821401978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:33:06.819838821 +0000 UTC m=+1400.914019013" watchObservedRunningTime="2026-09-10 12:33:06.821401978 +0000 UTC m=+1400.915582168"
Sep 10 12:33:06.838649 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:06.838611    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm" podStartSLOduration=1.838599507 podStartE2EDuration="1.838599507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:33:06.837837341 +0000 UTC m=+1400.932017533" watchObservedRunningTime="2026-09-10 12:33:06.838599507 +0000 UTC m=+1400.932779821"
Sep 10 12:33:15.641419 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:15.641384    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:16.591497 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:16.591466    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:17.781576 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:17.781546    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:17.810320 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:17.810299    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:33:17.810639 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:17.810619    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:33:26.095941 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:26.095905    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:28.733447 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:28.733389    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:31.359449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:31.359392    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:32.229205 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:32.229177    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:47.247571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.247489    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:47.310473 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.310440    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"]
Sep 10 12:33:47.310665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.310642    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm" podUID="30f62c2f-701b-4448-a52d-f6f85d3db2ff" containerName="payload-processing" containerID="cri-o://5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262" gracePeriod=30
Sep 10 12:33:47.368065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.368033    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:47.480302 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.480272    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:47.579018 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.578994    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:33:47.579684 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.579657    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:47.677721 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.677688    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:47.740881 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.740856    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f62c2f-701b-4448-a52d-f6f85d3db2ff-plugins-config-volume\") pod \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") "
Sep 10 12:33:47.741024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.740925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42hfc\" (UniqueName: \"kubernetes.io/projected/30f62c2f-701b-4448-a52d-f6f85d3db2ff-kube-api-access-42hfc\") pod \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\" (UID: \"30f62c2f-701b-4448-a52d-f6f85d3db2ff\") "
Sep 10 12:33:47.741208 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.741183    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f62c2f-701b-4448-a52d-f6f85d3db2ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30f62c2f-701b-4448-a52d-f6f85d3db2ff" (UID: "30f62c2f-701b-4448-a52d-f6f85d3db2ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:33:47.742952 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.742932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f62c2f-701b-4448-a52d-f6f85d3db2ff-kube-api-access-42hfc" (OuterVolumeSpecName: "kube-api-access-42hfc") pod "30f62c2f-701b-4448-a52d-f6f85d3db2ff" (UID: "30f62c2f-701b-4448-a52d-f6f85d3db2ff"). InnerVolumeSpecName "kube-api-access-42hfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:33:47.841952 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.841896    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f62c2f-701b-4448-a52d-f6f85d3db2ff-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:33:47.841952 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.841918    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42hfc\" (UniqueName: \"kubernetes.io/projected/30f62c2f-701b-4448-a52d-f6f85d3db2ff-kube-api-access-42hfc\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:33:47.964408 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:47.964383    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:48.039839 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.039813    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f62c2f-701b-4448-a52d-f6f85d3db2ff" containerID="5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262" exitCode=0
Sep 10 12:33:48.039958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.039851    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"
Sep 10 12:33:48.039958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.039874    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm" event={"ID":"30f62c2f-701b-4448-a52d-f6f85d3db2ff","Type":"ContainerDied","Data":"5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262"}
Sep 10 12:33:48.039958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.039925    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm" event={"ID":"30f62c2f-701b-4448-a52d-f6f85d3db2ff","Type":"ContainerDied","Data":"9c7ca80ef54bd1c0239137f598a7e6edf2d8e079c60b28c82c5688b243a0a6fc"}
Sep 10 12:33:48.039958 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.039956    2557 scope.go:117] "RemoveContainer" containerID="5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262"
Sep 10 12:33:48.049328 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.049309    2557 scope.go:117] "RemoveContainer" containerID="5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262"
Sep 10 12:33:48.049580 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:33:48.049564    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262\": container with ID starting with 5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262 not found: ID does not exist" containerID="5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262"
Sep 10 12:33:48.049632 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.049588    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262"} err="failed to get container status \"5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262\": rpc error: code = NotFound desc = could not find container \"5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262\": container with ID starting with 5c971534a142795b00d9df06ecd168f9c6c47f488aef3e3e3a9025056157c262 not found: ID does not exist"
Sep 10 12:33:48.067340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.067318    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"]
Sep 10 12:33:48.072812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.072792    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm"]
Sep 10 12:33:48.396557 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.396525    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f62c2f-701b-4448-a52d-f6f85d3db2ff" path="/var/lib/kubelet/pods/30f62c2f-701b-4448-a52d-f6f85d3db2ff/volumes"
Sep 10 12:33:48.677363 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:48.677266    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:54.778459 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:54.778391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:54.912348 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:54.912306    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:55.024757 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:55.024727    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"]
Sep 10 12:33:55.025004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:55.024979    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" containerID="cri-o://f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70" gracePeriod=30
Sep 10 12:33:55.062242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:55.062160    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:55.543642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:55.543600    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:33:57.031852 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:57.031817    2557 patch_prober.go:28] interesting pod/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 12:33:57.032202 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:57.031879    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:33:59.523256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:33:59.523220    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:00.270333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.270310    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:34:00.344957 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.344900    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk9qj\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-kube-api-access-kk9qj\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.344957 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.344930    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istiod-ca-cert\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345128 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.344973    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-envoy\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345128 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.344995    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-token\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345128 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345060    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-socket\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345128 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345088    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-certs\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345128 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345121    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-data\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345174    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-credential-socket\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345206    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-podinfo\") pod \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\" (UID: \"4f05b757-fd59-4f44-b0f9-d8ea6685a50c\") "
Sep 10 12:34:00.345382 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345352    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:00.345588 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345381    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:00.345588 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345519    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:00.345761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345650    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:00.345761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345666    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:00.345874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345778    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.345874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345798    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.345874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345806    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.345874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345814    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.345874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.345823    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.347123 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.347097    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:00.347223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.347181    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:00.347494 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.347475    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:34:00.347494 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.347487    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-kube-api-access-kk9qj" (OuterVolumeSpecName: "kube-api-access-kk9qj") pod "4f05b757-fd59-4f44-b0f9-d8ea6685a50c" (UID: "4f05b757-fd59-4f44-b0f9-d8ea6685a50c"). InnerVolumeSpecName "kube-api-access-kk9qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:00.446739 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.446718    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.446853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.446780    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.446853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.446795    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:00.446853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:00.446823    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk9qj\" (UniqueName: \"kubernetes.io/projected/4f05b757-fd59-4f44-b0f9-d8ea6685a50c-kube-api-access-kk9qj\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:01.116567 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.116536    2557 generic.go:356] "Generic (PLEG): container finished" podID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerID="f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70" exitCode=0
Sep 10 12:34:01.116948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.116592    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"
Sep 10 12:34:01.116948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.116631    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" event={"ID":"4f05b757-fd59-4f44-b0f9-d8ea6685a50c","Type":"ContainerDied","Data":"f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70"}
Sep 10 12:34:01.116948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.116687    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx" event={"ID":"4f05b757-fd59-4f44-b0f9-d8ea6685a50c","Type":"ContainerDied","Data":"5600169998ecc02fe83ac5ea47b31752b459ddc59185e935cf5cd2464b889f12"}
Sep 10 12:34:01.116948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.116716    2557 scope.go:117] "RemoveContainer" containerID="f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70"
Sep 10 12:34:01.125939 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.125919    2557 scope.go:117] "RemoveContainer" containerID="80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"
Sep 10 12:34:01.133928 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.133912    2557 scope.go:117] "RemoveContainer" containerID="f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70"
Sep 10 12:34:01.134185 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:34:01.134168    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70\": container with ID starting with f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70 not found: ID does not exist" containerID="f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70"
Sep 10 12:34:01.134251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.134192    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70"} err="failed to get container status \"f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70\": rpc error: code = NotFound desc = could not find container \"f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70\": container with ID starting with f3c8ec8d813dfac7faf29e40452432d38f6803b6ca094c7eb504e96ca8d1dd70 not found: ID does not exist"
Sep 10 12:34:01.134251 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.134207    2557 scope.go:117] "RemoveContainer" containerID="80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"
Sep 10 12:34:01.134469 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:34:01.134451    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92\": container with ID starting with 80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92 not found: ID does not exist" containerID="80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"
Sep 10 12:34:01.134507 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.134476    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92"} err="failed to get container status \"80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92\": rpc error: code = NotFound desc = could not find container \"80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92\": container with ID starting with 80bddc0a9c03d51634b9d875bdb1b7cd29ffd56cfb38f92b3a67115325ebda92 not found: ID does not exist"
Sep 10 12:34:01.139244 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.139224    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"]
Sep 10 12:34:01.143119 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:01.143101    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx"]
Sep 10 12:34:02.389994 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:02.389968    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" path="/var/lib/kubelet/pods/4f05b757-fd59-4f44-b0f9-d8ea6685a50c/volumes"
Sep 10 12:34:05.578587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:05.578554    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:11.280381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.280347    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:11.337953 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.337925    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"]
Sep 10 12:34:11.338150 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.338116    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm" podUID="640e5889-2629-41cf-a37c-13f6e6445dab" containerName="payload-processing" containerID="cri-o://7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33" gracePeriod=30
Sep 10 12:34:11.364303 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.364268    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"]
Sep 10 12:34:11.364514 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.364488    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2" podUID="d32f9f18-da5e-458b-aef5-4d9eba17ef8a" containerName="payload-pre-processing" containerID="cri-o://32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a" gracePeriod=30
Sep 10 12:34:11.426159 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.426131    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:11.562452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.562388    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:11.635514 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.635492    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:34:11.638323 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.638303    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:34:11.649025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.649006    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:11.741220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.741186    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thqjt\" (UniqueName: \"kubernetes.io/projected/640e5889-2629-41cf-a37c-13f6e6445dab-kube-api-access-thqjt\") pod \"640e5889-2629-41cf-a37c-13f6e6445dab\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") "
Sep 10 12:34:11.741389 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.741228    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640e5889-2629-41cf-a37c-13f6e6445dab-plugins-config-volume\") pod \"640e5889-2629-41cf-a37c-13f6e6445dab\" (UID: \"640e5889-2629-41cf-a37c-13f6e6445dab\") "
Sep 10 12:34:11.741389 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.741272    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-plugins-config-volume\") pod \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") "
Sep 10 12:34:11.741389 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.741296    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjwdh\" (UniqueName: \"kubernetes.io/projected/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-kube-api-access-jjwdh\") pod \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\" (UID: \"d32f9f18-da5e-458b-aef5-4d9eba17ef8a\") "
Sep 10 12:34:11.741640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.741617    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/640e5889-2629-41cf-a37c-13f6e6445dab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "640e5889-2629-41cf-a37c-13f6e6445dab" (UID: "640e5889-2629-41cf-a37c-13f6e6445dab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:11.741698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.741666    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d32f9f18-da5e-458b-aef5-4d9eba17ef8a" (UID: "d32f9f18-da5e-458b-aef5-4d9eba17ef8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:11.743306 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.743285    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-kube-api-access-jjwdh" (OuterVolumeSpecName: "kube-api-access-jjwdh") pod "d32f9f18-da5e-458b-aef5-4d9eba17ef8a" (UID: "d32f9f18-da5e-458b-aef5-4d9eba17ef8a"). InnerVolumeSpecName "kube-api-access-jjwdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:11.743374 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.743319    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640e5889-2629-41cf-a37c-13f6e6445dab-kube-api-access-thqjt" (OuterVolumeSpecName: "kube-api-access-thqjt") pod "640e5889-2629-41cf-a37c-13f6e6445dab" (UID: "640e5889-2629-41cf-a37c-13f6e6445dab"). InnerVolumeSpecName "kube-api-access-thqjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:11.842214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.842148    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thqjt\" (UniqueName: \"kubernetes.io/projected/640e5889-2629-41cf-a37c-13f6e6445dab-kube-api-access-thqjt\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:11.842214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.842170    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640e5889-2629-41cf-a37c-13f6e6445dab-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:11.842214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.842179    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:11.842214 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.842188    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjwdh\" (UniqueName: \"kubernetes.io/projected/d32f9f18-da5e-458b-aef5-4d9eba17ef8a-kube-api-access-jjwdh\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:11.959955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:11.959922    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:12.179440 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.179407    2557 generic.go:356] "Generic (PLEG): container finished" podID="640e5889-2629-41cf-a37c-13f6e6445dab" containerID="7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33" exitCode=0
Sep 10 12:34:12.179609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.179474    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"
Sep 10 12:34:12.179609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.179495    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm" event={"ID":"640e5889-2629-41cf-a37c-13f6e6445dab","Type":"ContainerDied","Data":"7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33"}
Sep 10 12:34:12.179609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.179583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm" event={"ID":"640e5889-2629-41cf-a37c-13f6e6445dab","Type":"ContainerDied","Data":"4bd0ba0baa9a664b05d0bedb400ba20d65aac03833f6b680ab6a0b1786bf0955"}
Sep 10 12:34:12.179758 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.179611    2557 scope.go:117] "RemoveContainer" containerID="7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33"
Sep 10 12:34:12.181019 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.180996    2557 generic.go:356] "Generic (PLEG): container finished" podID="d32f9f18-da5e-458b-aef5-4d9eba17ef8a" containerID="32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a" exitCode=0
Sep 10 12:34:12.181131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.181027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2" event={"ID":"d32f9f18-da5e-458b-aef5-4d9eba17ef8a","Type":"ContainerDied","Data":"32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a"}
Sep 10 12:34:12.181131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.181060    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"
Sep 10 12:34:12.181131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.181079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2" event={"ID":"d32f9f18-da5e-458b-aef5-4d9eba17ef8a","Type":"ContainerDied","Data":"48d3f3733b4d1ab67bc470d06d57162a4b59156967106a7914f9c8efe2a36c12"}
Sep 10 12:34:12.188705 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.188688    2557 scope.go:117] "RemoveContainer" containerID="7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33"
Sep 10 12:34:12.188992 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:34:12.188973    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33\": container with ID starting with 7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33 not found: ID does not exist" containerID="7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33"
Sep 10 12:34:12.189073 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.189004    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33"} err="failed to get container status \"7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33\": rpc error: code = NotFound desc = could not find container \"7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33\": container with ID starting with 7f4649f78a732361865a293cc83697668bbd5b01680a5b14785244d17ea0ef33 not found: ID does not exist"
Sep 10 12:34:12.189073 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.189026    2557 scope.go:117] "RemoveContainer" containerID="32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a"
Sep 10 12:34:12.197580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.197562    2557 scope.go:117] "RemoveContainer" containerID="32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a"
Sep 10 12:34:12.197841 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:34:12.197824    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a\": container with ID starting with 32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a not found: ID does not exist" containerID="32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a"
Sep 10 12:34:12.197903 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.197849    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a"} err="failed to get container status \"32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a\": rpc error: code = NotFound desc = could not find container \"32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a\": container with ID starting with 32786d48234a59086d43ca819ad6ffed4195ef66252edcf93f9c68bfb2a5cb2a not found: ID does not exist"
Sep 10 12:34:12.208026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.208003    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"]
Sep 10 12:34:12.213409 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.213388    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm"]
Sep 10 12:34:12.227666 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.227648    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"]
Sep 10 12:34:12.230765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.230746    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2"]
Sep 10 12:34:12.390546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.390522    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640e5889-2629-41cf-a37c-13f6e6445dab" path="/var/lib/kubelet/pods/640e5889-2629-41cf-a37c-13f6e6445dab/volumes"
Sep 10 12:34:12.390879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:12.390867    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d32f9f18-da5e-458b-aef5-4d9eba17ef8a" path="/var/lib/kubelet/pods/d32f9f18-da5e-458b-aef5-4d9eba17ef8a/volumes"
Sep 10 12:34:19.657372 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657337    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"]
Sep 10 12:34:19.657774 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657758    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32f9f18-da5e-458b-aef5-4d9eba17ef8a" containerName="payload-pre-processing"
Sep 10 12:34:19.657818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657776    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32f9f18-da5e-458b-aef5-4d9eba17ef8a" containerName="payload-pre-processing"
Sep 10 12:34:19.657818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657785    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640e5889-2629-41cf-a37c-13f6e6445dab" containerName="payload-processing"
Sep 10 12:34:19.657818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657791    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="640e5889-2629-41cf-a37c-13f6e6445dab" containerName="payload-processing"
Sep 10 12:34:19.657818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657799    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f62c2f-701b-4448-a52d-f6f85d3db2ff" containerName="payload-processing"
Sep 10 12:34:19.657818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657804    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f62c2f-701b-4448-a52d-f6f85d3db2ff" containerName="payload-processing"
Sep 10 12:34:19.657818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657819    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657825    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657840    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657844    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657900    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657908    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d32f9f18-da5e-458b-aef5-4d9eba17ef8a" containerName="payload-pre-processing"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657915    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f05b757-fd59-4f44-b0f9-d8ea6685a50c" containerName="istio-proxy"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657920    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="640e5889-2629-41cf-a37c-13f6e6445dab" containerName="payload-processing"
Sep 10 12:34:19.658003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.657926    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f62c2f-701b-4448-a52d-f6f85d3db2ff" containerName="payload-processing"
Sep 10 12:34:19.660977 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.660958    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:19.666690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.666669    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:34:19.666783 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.666712    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:34:19.675330 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.675309    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"]
Sep 10 12:34:19.707075 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.707038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea033fb-969a-4094-a678-20d8047faf02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm\" (UID: \"1ea033fb-969a-4094-a678-20d8047faf02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:19.808618 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.808587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea033fb-969a-4094-a678-20d8047faf02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm\" (UID: \"1ea033fb-969a-4094-a678-20d8047faf02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:19.809132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.809113    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea033fb-969a-4094-a678-20d8047faf02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm\" (UID: \"1ea033fb-969a-4094-a678-20d8047faf02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:19.970603 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:19.970523    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:20.105610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:20.105575    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:20.248127 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:20.248099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"]
Sep 10 12:34:20.249300 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:34:20.249274    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea033fb_969a_4094_a678_20d8047faf02.slice/crio-ddcc210c03d0c365add3f376b741e8f5d1d6d956cd36714a6b902b04ed44664f WatchSource:0}: Error finding container ddcc210c03d0c365add3f376b741e8f5d1d6d956cd36714a6b902b04ed44664f: Status 404 returned error can't find the container with id ddcc210c03d0c365add3f376b741e8f5d1d6d956cd36714a6b902b04ed44664f
Sep 10 12:34:20.272617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:20.272597    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:21.237108 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:21.237036    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ea033fb-969a-4094-a678-20d8047faf02" containerID="db125413fff182f750075b4e81892ef9a036c2039763e5d4ed2da45f7476ed3b" exitCode=0
Sep 10 12:34:21.237108 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:21.237081    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm" event={"ID":"1ea033fb-969a-4094-a678-20d8047faf02","Type":"ContainerDied","Data":"db125413fff182f750075b4e81892ef9a036c2039763e5d4ed2da45f7476ed3b"}
Sep 10 12:34:21.237472 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:21.237142    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm" event={"ID":"1ea033fb-969a-4094-a678-20d8047faf02","Type":"ContainerStarted","Data":"ddcc210c03d0c365add3f376b741e8f5d1d6d956cd36714a6b902b04ed44664f"}
Sep 10 12:34:22.366823 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:22.366801    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:22.428110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:22.428078    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea033fb-969a-4094-a678-20d8047faf02-maas-api-service-ca\") pod \"1ea033fb-969a-4094-a678-20d8047faf02\" (UID: \"1ea033fb-969a-4094-a678-20d8047faf02\") "
Sep 10 12:34:22.428495 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:22.428465    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea033fb-969a-4094-a678-20d8047faf02-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ea033fb-969a-4094-a678-20d8047faf02" (UID: "1ea033fb-969a-4094-a678-20d8047faf02"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:22.428605 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:22.428573    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea033fb-969a-4094-a678-20d8047faf02-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:23.250459 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:23.250404    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm" event={"ID":"1ea033fb-969a-4094-a678-20d8047faf02","Type":"ContainerDied","Data":"ddcc210c03d0c365add3f376b741e8f5d1d6d956cd36714a6b902b04ed44664f"}
Sep 10 12:34:23.250459 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:23.250445    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"
Sep 10 12:34:23.250626 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:23.250476    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddcc210c03d0c365add3f376b741e8f5d1d6d956cd36714a6b902b04ed44664f"
Sep 10 12:34:25.775226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:25.775157    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:29.782991 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:29.782958    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:30.506819 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.506784    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:30.509002 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.508981    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"]
Sep 10 12:34:30.513332 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.513299    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-d1e553-29817390-kvkhc"]
Sep 10 12:34:30.548496 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.548468    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"]
Sep 10 12:34:30.548745 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.548719    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq" podUID="75579792-6cb4-410d-9fe6-00e4b7404ba5" containerName="payload-processing" containerID="cri-o://3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf" gracePeriod=30
Sep 10 12:34:30.603336 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.603307    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:30.705600 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.705570    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:30.738221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.738195    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"]
Sep 10 12:34:30.746169 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.746142    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-d1e553-pzdtm"]
Sep 10 12:34:30.797061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.797039    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:34:30.805663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.805643    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:30.895702 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.895662    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj9kz\" (UniqueName: \"kubernetes.io/projected/75579792-6cb4-410d-9fe6-00e4b7404ba5-kube-api-access-fj9kz\") pod \"75579792-6cb4-410d-9fe6-00e4b7404ba5\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") "
Sep 10 12:34:30.895887 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.895794    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75579792-6cb4-410d-9fe6-00e4b7404ba5-plugins-config-volume\") pod \"75579792-6cb4-410d-9fe6-00e4b7404ba5\" (UID: \"75579792-6cb4-410d-9fe6-00e4b7404ba5\") "
Sep 10 12:34:30.896123 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.896101    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75579792-6cb4-410d-9fe6-00e4b7404ba5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75579792-6cb4-410d-9fe6-00e4b7404ba5" (UID: "75579792-6cb4-410d-9fe6-00e4b7404ba5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:30.897878 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.897848    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75579792-6cb4-410d-9fe6-00e4b7404ba5-kube-api-access-fj9kz" (OuterVolumeSpecName: "kube-api-access-fj9kz") pod "75579792-6cb4-410d-9fe6-00e4b7404ba5" (UID: "75579792-6cb4-410d-9fe6-00e4b7404ba5"). InnerVolumeSpecName "kube-api-access-fj9kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:30.997301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.997268    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75579792-6cb4-410d-9fe6-00e4b7404ba5-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:30.997301 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:30.997300    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj9kz\" (UniqueName: \"kubernetes.io/projected/75579792-6cb4-410d-9fe6-00e4b7404ba5-kube-api-access-fj9kz\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:31.078091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.078015    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:31.304224 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.304200    2557 generic.go:356] "Generic (PLEG): container finished" podID="75579792-6cb4-410d-9fe6-00e4b7404ba5" containerID="3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf" exitCode=0
Sep 10 12:34:31.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.304253    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"
Sep 10 12:34:31.304335 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.304284    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq" event={"ID":"75579792-6cb4-410d-9fe6-00e4b7404ba5","Type":"ContainerDied","Data":"3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf"}
Sep 10 12:34:31.304436 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.304361    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq" event={"ID":"75579792-6cb4-410d-9fe6-00e4b7404ba5","Type":"ContainerDied","Data":"5a47ab07d3edc6d16912c3c412522e2969d91e5ce6f9c163e060eb09a9b63a2f"}
Sep 10 12:34:31.304436 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.304383    2557 scope.go:117] "RemoveContainer" containerID="3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf"
Sep 10 12:34:31.314256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.314237    2557 scope.go:117] "RemoveContainer" containerID="3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf"
Sep 10 12:34:31.314546 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:34:31.314528    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf\": container with ID starting with 3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf not found: ID does not exist" containerID="3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf"
Sep 10 12:34:31.314596 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.314554    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf"} err="failed to get container status \"3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf\": rpc error: code = NotFound desc = could not find container \"3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf\": container with ID starting with 3a4c25821ea17fb54b096ff90bd122d312170968732708876bee9853b483a5cf not found: ID does not exist"
Sep 10 12:34:31.327133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.327106    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"]
Sep 10 12:34:31.330549 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:31.330504    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq"]
Sep 10 12:34:32.390352 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:32.390325    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea033fb-969a-4094-a678-20d8047faf02" path="/var/lib/kubelet/pods/1ea033fb-969a-4094-a678-20d8047faf02/volumes"
Sep 10 12:34:32.390713 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:32.390609    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3830e5b7-1633-4a7c-bf79-d3902c078762" path="/var/lib/kubelet/pods/3830e5b7-1633-4a7c-bf79-d3902c078762/volumes"
Sep 10 12:34:32.390879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:32.390866    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75579792-6cb4-410d-9fe6-00e4b7404ba5" path="/var/lib/kubelet/pods/75579792-6cb4-410d-9fe6-00e4b7404ba5/volumes"
Sep 10 12:34:37.923227 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:37.923190    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:38.016523 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.016489    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:38.187131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.187054    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"]
Sep 10 12:34:38.187288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.187267    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy" containerID="cri-o://63eb94416087b93149056de6c0ad783aeff0a5c43892d4f1cfbe17fd845040cd" gracePeriod=30
Sep 10 12:34:38.222608 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.222573    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:38.673126 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673093    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"]
Sep 10 12:34:38.673628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673600    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea033fb-969a-4094-a678-20d8047faf02" containerName="revoke-keys"
Sep 10 12:34:38.673628 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673623    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea033fb-969a-4094-a678-20d8047faf02" containerName="revoke-keys"
Sep 10 12:34:38.673773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673637    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75579792-6cb4-410d-9fe6-00e4b7404ba5" containerName="payload-processing"
Sep 10 12:34:38.673773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673646    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="75579792-6cb4-410d-9fe6-00e4b7404ba5" containerName="payload-processing"
Sep 10 12:34:38.673773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673725    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="75579792-6cb4-410d-9fe6-00e4b7404ba5" containerName="payload-processing"
Sep 10 12:34:38.673773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.673742    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea033fb-969a-4094-a678-20d8047faf02" containerName="revoke-keys"
Sep 10 12:34:38.678112 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.678096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:38.682665 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.682649    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:34:38.682744 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.682731    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:34:38.689789 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.689768    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"]
Sep 10 12:34:38.764594 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.764566    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68cd468b-608c-4d19-9b8d-798bc9780ba4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh\" (UID: \"68cd468b-608c-4d19-9b8d-798bc9780ba4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:38.840915 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.840890    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:38.865976 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.865954    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68cd468b-608c-4d19-9b8d-798bc9780ba4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh\" (UID: \"68cd468b-608c-4d19-9b8d-798bc9780ba4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:38.866490 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.866474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68cd468b-608c-4d19-9b8d-798bc9780ba4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh\" (UID: \"68cd468b-608c-4d19-9b8d-798bc9780ba4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:38.956841 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.956757    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:38.988510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:38.988482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:39.263038 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:39.263014    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"]
Sep 10 12:34:39.263946 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:34:39.263921    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cd468b_608c_4d19_9b8d_798bc9780ba4.slice/crio-ed7783f021093095ad11f1d11a1e8d9ee30d97c4ba734b5a08955aac83754fc1 WatchSource:0}: Error finding container ed7783f021093095ad11f1d11a1e8d9ee30d97c4ba734b5a08955aac83754fc1: Status 404 returned error can't find the container with id ed7783f021093095ad11f1d11a1e8d9ee30d97c4ba734b5a08955aac83754fc1
Sep 10 12:34:39.353787 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:39.353753    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh" event={"ID":"68cd468b-608c-4d19-9b8d-798bc9780ba4","Type":"ContainerStarted","Data":"ed7783f021093095ad11f1d11a1e8d9ee30d97c4ba734b5a08955aac83754fc1"}
Sep 10 12:34:39.697272 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:39.697240    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:40.101177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.101144    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:40.360701 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.360669    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"]
Sep 10 12:34:40.362679 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.362655    2557 generic.go:356] "Generic (PLEG): container finished" podID="68cd468b-608c-4d19-9b8d-798bc9780ba4" containerID="07c14d8136395742230b70e807ca52df9b6123ebae4eafa0a0096e2cae1d8ac5" exitCode=0
Sep 10 12:34:40.364322 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.364299    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh" event={"ID":"68cd468b-608c-4d19-9b8d-798bc9780ba4","Type":"ContainerDied","Data":"07c14d8136395742230b70e807ca52df9b6123ebae4eafa0a0096e2cae1d8ac5"}
Sep 10 12:34:40.364438 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.364396    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.367171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.367148    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-3db7ea-openshift-default-dockercfg-nd9mm\""
Sep 10 12:34:40.379506 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.379483    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"]
Sep 10 12:34:40.388933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.388907    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:40.480099 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.480058    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-credential-socket\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.480372 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.480350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab18766-3055-4331-9320-5ff3b2484e31-istiod-ca-cert\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.480576 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.480556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-socket\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.480716 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.480699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-certs\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.480880 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.480864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab18766-3055-4331-9320-5ff3b2484e31-istio-podinfo\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.481013 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.480995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-data\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.481132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.481118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-istio-token\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.481307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.481283    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-envoy\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.481455 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.481380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdz47\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-kube-api-access-zdz47\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582259 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab18766-3055-4331-9320-5ff3b2484e31-istio-podinfo\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-data\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-istio-token\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-envoy\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdz47\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-kube-api-access-zdz47\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-credential-socket\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582582 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab18766-3055-4331-9320-5ff3b2484e31-istiod-ca-cert\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-socket\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582663 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-certs\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582762 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582727    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-data\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582889 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582863    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-credential-socket\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.582986 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-socket\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.583046 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.582978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-certs\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.583189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.583171    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab18766-3055-4331-9320-5ff3b2484e31-istiod-ca-cert\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.584674 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.584646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-envoy\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.584785 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.584768    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab18766-3055-4331-9320-5ff3b2484e31-istio-podinfo\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.592189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.592166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdz47\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-kube-api-access-zdz47\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.592727 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.592708    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-istio-token\") pod \"e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") " pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.680490 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.680401    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:40.682054 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.682039    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:40.966706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.966678    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"]
Sep 10 12:34:40.967511 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:34:40.967484    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab18766_3055_4331_9320_5ff3b2484e31.slice/crio-00f7c72fbe3e3d16caa3a0c38a95ca72042f95c253649387bd67d23842cec10b WatchSource:0}: Error finding container 00f7c72fbe3e3d16caa3a0c38a95ca72042f95c253649387bd67d23842cec10b: Status 404 returned error can't find the container with id 00f7c72fbe3e3d16caa3a0c38a95ca72042f95c253649387bd67d23842cec10b
Sep 10 12:34:40.969820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.969790    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:34:40.969924 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.969860    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:34:40.969924 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:40.969901    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:34:41.373026 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.372994    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" event={"ID":"4ab18766-3055-4331-9320-5ff3b2484e31","Type":"ContainerStarted","Data":"ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"}
Sep 10 12:34:41.373494 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.373055    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" event={"ID":"4ab18766-3055-4331-9320-5ff3b2484e31","Type":"ContainerStarted","Data":"00f7c72fbe3e3d16caa3a0c38a95ca72042f95c253649387bd67d23842cec10b"}
Sep 10 12:34:41.397083 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.397033    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podStartSLOduration=1.397016413 podStartE2EDuration="1.397016413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:34:41.395312518 +0000 UTC m=+1495.489492709" watchObservedRunningTime="2026-09-10 12:34:41.397016413 +0000 UTC m=+1495.491196603"
Sep 10 12:34:41.492722 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.492697    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:41.590969 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.590940    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68cd468b-608c-4d19-9b8d-798bc9780ba4-maas-api-service-ca\") pod \"68cd468b-608c-4d19-9b8d-798bc9780ba4\" (UID: \"68cd468b-608c-4d19-9b8d-798bc9780ba4\") "
Sep 10 12:34:41.591272 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.591249    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68cd468b-608c-4d19-9b8d-798bc9780ba4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68cd468b-608c-4d19-9b8d-798bc9780ba4" (UID: "68cd468b-608c-4d19-9b8d-798bc9780ba4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:41.682996 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.682940    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:41.692397 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:41.692379    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68cd468b-608c-4d19-9b8d-798bc9780ba4-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:42.380221 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:42.380199    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"
Sep 10 12:34:42.380561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:42.380238    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh" event={"ID":"68cd468b-608c-4d19-9b8d-798bc9780ba4","Type":"ContainerDied","Data":"ed7783f021093095ad11f1d11a1e8d9ee30d97c4ba734b5a08955aac83754fc1"}
Sep 10 12:34:42.380561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:42.380281    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed7783f021093095ad11f1d11a1e8d9ee30d97c4ba734b5a08955aac83754fc1"
Sep 10 12:34:42.687359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:42.687307    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:43.312148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.312121    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:43.389200 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.389174    2557 generic.go:356] "Generic (PLEG): container finished" podID="47b5a33e-050a-4273-a075-93277de2ba79" containerID="63eb94416087b93149056de6c0ad783aeff0a5c43892d4f1cfbe17fd845040cd" exitCode=0
Sep 10 12:34:43.389591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.389240    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" event={"ID":"47b5a33e-050a-4273-a075-93277de2ba79","Type":"ContainerDied","Data":"63eb94416087b93149056de6c0ad783aeff0a5c43892d4f1cfbe17fd845040cd"}
Sep 10 12:34:43.389591 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.389300    2557 scope.go:117] "RemoveContainer" containerID="7d1c7298894c0d066948a21e003f2b5bcf6c6f53d7409dca1ae2545aef1dc627"
Sep 10 12:34:43.389700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.389666    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:43.390834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.390816    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:34:43.419838 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.419819    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:43.433922 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.433902    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:34:43.607223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607188    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-certs\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607419 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607235    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-credential-socket\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607419 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607268    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b5a33e-050a-4273-a075-93277de2ba79-istiod-ca-cert\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607419 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607298    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-data\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607505    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:43.607634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607548    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:43.607634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607559    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-data" (OuterVolumeSpecName: "istio-data") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:43.607634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607590    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-envoy\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607624    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b5a33e-050a-4273-a075-93277de2ba79-istio-podinfo\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607895 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607637    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47b5a33e-050a-4273-a075-93277de2ba79-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:43.607895 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607715    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crfrg\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-kube-api-access-crfrg\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607895 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607765    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-istio-token\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.607895 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.607804    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-socket\") pod \"47b5a33e-050a-4273-a075-93277de2ba79\" (UID: \"47b5a33e-050a-4273-a075-93277de2ba79\") "
Sep 10 12:34:43.608199 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.608178    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.608359 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.608342    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.608492 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.608475    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b5a33e-050a-4273-a075-93277de2ba79-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.608589 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.608577    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.608677 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.608528    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:43.610141 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.610119    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:34:43.610248 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.610205    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-kube-api-access-crfrg" (OuterVolumeSpecName: "kube-api-access-crfrg") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "kube-api-access-crfrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:43.610532 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.610500    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-istio-token" (OuterVolumeSpecName: "istio-token") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:43.610532 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.610508    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47b5a33e-050a-4273-a075-93277de2ba79-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47b5a33e-050a-4273-a075-93277de2ba79" (UID: "47b5a33e-050a-4273-a075-93277de2ba79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:34:43.709627 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.709605    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.709627 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.709634    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b5a33e-050a-4273-a075-93277de2ba79-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.709764 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.709644    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crfrg\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-kube-api-access-crfrg\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.709764 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.709654    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b5a33e-050a-4273-a075-93277de2ba79-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:43.709764 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:43.709662    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b5a33e-050a-4273-a075-93277de2ba79-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:44.395926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.395900    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"
Sep 10 12:34:44.396291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.395953    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht" event={"ID":"47b5a33e-050a-4273-a075-93277de2ba79","Type":"ContainerDied","Data":"ea181e5d735626cb17d3a8cd26c45f47ea4fdf40b5204de65af37e3f87467647"}
Sep 10 12:34:44.396291 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.396005    2557 scope.go:117] "RemoveContainer" containerID="63eb94416087b93149056de6c0ad783aeff0a5c43892d4f1cfbe17fd845040cd"
Sep 10 12:34:44.423133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.423110    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"]
Sep 10 12:34:44.429009 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.428987    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht"]
Sep 10 12:34:44.497580 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.497554    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:44.591583 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:44.591550    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:45.024897 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.024869    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:45.125567 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.125539    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:45.157501 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157472    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"]
Sep 10 12:34:45.157851 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157839    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68cd468b-608c-4d19-9b8d-798bc9780ba4" containerName="revoke-keys"
Sep 10 12:34:45.157896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157854    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68cd468b-608c-4d19-9b8d-798bc9780ba4" containerName="revoke-keys"
Sep 10 12:34:45.157896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157873    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy"
Sep 10 12:34:45.157896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157879    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy"
Sep 10 12:34:45.157896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157889    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy"
Sep 10 12:34:45.157896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157895    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy"
Sep 10 12:34:45.158035 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157953    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy"
Sep 10 12:34:45.158035 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.157965    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="68cd468b-608c-4d19-9b8d-798bc9780ba4" containerName="revoke-keys"
Sep 10 12:34:45.162126 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.162105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.165330 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.165312    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-3db7ea\""
Sep 10 12:34:45.181536 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.181513    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"]
Sep 10 12:34:45.224625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.224604    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"]
Sep 10 12:34:45.225023 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.225011    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b5a33e-050a-4273-a075-93277de2ba79" containerName="istio-proxy"
Sep 10 12:34:45.227930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.227915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.231354 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.231336    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-3db7ea-dockercfg-sslpm\""
Sep 10 12:34:45.245283 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.245262    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"]
Sep 10 12:34:45.323935 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.323856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73cab0bc-f1b1-4f63-bdff-4780b53032c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.323935 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.323903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cd58070-5cc3-42a4-81c1-49e62d789c67-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.324109 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.323954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhh4\" (UniqueName: \"kubernetes.io/projected/73cab0bc-f1b1-4f63-bdff-4780b53032c8-kube-api-access-qfhh4\") pod \"payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.324109 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.323974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxvk\" (UniqueName: \"kubernetes.io/projected/1cd58070-5cc3-42a4-81c1-49e62d789c67-kube-api-access-dvxvk\") pod \"payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.425208 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.425186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73cab0bc-f1b1-4f63-bdff-4780b53032c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.425546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.425226    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cd58070-5cc3-42a4-81c1-49e62d789c67-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.425546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.425251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhh4\" (UniqueName: \"kubernetes.io/projected/73cab0bc-f1b1-4f63-bdff-4780b53032c8-kube-api-access-qfhh4\") pod \"payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.425546 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.425289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxvk\" (UniqueName: \"kubernetes.io/projected/1cd58070-5cc3-42a4-81c1-49e62d789c67-kube-api-access-dvxvk\") pod \"payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.425921 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.425905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cd58070-5cc3-42a4-81c1-49e62d789c67-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.426042 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.426025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73cab0bc-f1b1-4f63-bdff-4780b53032c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.436676 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.436658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhh4\" (UniqueName: \"kubernetes.io/projected/73cab0bc-f1b1-4f63-bdff-4780b53032c8-kube-api-access-qfhh4\") pod \"payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.442770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.442744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxvk\" (UniqueName: \"kubernetes.io/projected/1cd58070-5cc3-42a4-81c1-49e62d789c67-kube-api-access-dvxvk\") pod \"payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.472599 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.472575    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:45.537686 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.537656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:45.751651 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:34:45.751618    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cab0bc_f1b1_4f63_bdff_4780b53032c8.slice/crio-0caaa79f385183f4ca2bc5a25c96f255c33ce738ea72edf7e66c923a88e9ce4c WatchSource:0}: Error finding container 0caaa79f385183f4ca2bc5a25c96f255c33ce738ea72edf7e66c923a88e9ce4c: Status 404 returned error can't find the container with id 0caaa79f385183f4ca2bc5a25c96f255c33ce738ea72edf7e66c923a88e9ce4c
Sep 10 12:34:45.754881 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.754853    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"]
Sep 10 12:34:45.831540 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:45.831518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"]
Sep 10 12:34:45.832894 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:34:45.832875    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd58070_5cc3_42a4_81c1_49e62d789c67.slice/crio-0ee8ba83432025732da55742e7efb92ef5ff76a48ebc28c0744a784a6ce6152c WatchSource:0}: Error finding container 0ee8ba83432025732da55742e7efb92ef5ff76a48ebc28c0744a784a6ce6152c: Status 404 returned error can't find the container with id 0ee8ba83432025732da55742e7efb92ef5ff76a48ebc28c0744a784a6ce6152c
Sep 10 12:34:46.391884 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.391854    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47b5a33e-050a-4273-a075-93277de2ba79" path="/var/lib/kubelet/pods/47b5a33e-050a-4273-a075-93277de2ba79/volumes"
Sep 10 12:34:46.410984 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.410956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56" event={"ID":"73cab0bc-f1b1-4f63-bdff-4780b53032c8","Type":"ContainerStarted","Data":"316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205"}
Sep 10 12:34:46.411140 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.411011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56" event={"ID":"73cab0bc-f1b1-4f63-bdff-4780b53032c8","Type":"ContainerStarted","Data":"0caaa79f385183f4ca2bc5a25c96f255c33ce738ea72edf7e66c923a88e9ce4c"}
Sep 10 12:34:46.411140 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.411127    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:46.412622 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.412594    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2" event={"ID":"1cd58070-5cc3-42a4-81c1-49e62d789c67","Type":"ContainerStarted","Data":"f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918"}
Sep 10 12:34:46.412725 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.412637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2" event={"ID":"1cd58070-5cc3-42a4-81c1-49e62d789c67","Type":"ContainerStarted","Data":"0ee8ba83432025732da55742e7efb92ef5ff76a48ebc28c0744a784a6ce6152c"}
Sep 10 12:34:46.412725 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.412665    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:46.433615 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.433582    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56" podStartSLOduration=1.4335687639999999 podStartE2EDuration="1.433568764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:34:46.433339637 +0000 UTC m=+1500.527519829" watchObservedRunningTime="2026-09-10 12:34:46.433568764 +0000 UTC m=+1500.527748986"
Sep 10 12:34:46.465634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:46.465597    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2" podStartSLOduration=1.465584324 podStartE2EDuration="1.465584324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:34:46.463874447 +0000 UTC m=+1500.558054639" watchObservedRunningTime="2026-09-10 12:34:46.465584324 +0000 UTC m=+1500.559764514"
Sep 10 12:34:48.868133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:48.868104    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:49.844025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:49.843988    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:49.905838 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:49.905811    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"]
Sep 10 12:34:49.906230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:49.905999    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s" podUID="2033b2c3-c88c-4085-8de1-040ecbdc7294" containerName="payload-processing" containerID="cri-o://9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a" gracePeriod=30
Sep 10 12:34:49.976189 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:49.976158    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:50.158413 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.158385    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:50.171588 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.171569    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:34:50.267456 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.267414    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcwdx\" (UniqueName: \"kubernetes.io/projected/2033b2c3-c88c-4085-8de1-040ecbdc7294-kube-api-access-tcwdx\") pod \"2033b2c3-c88c-4085-8de1-040ecbdc7294\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") "
Sep 10 12:34:50.267640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.267474    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2033b2c3-c88c-4085-8de1-040ecbdc7294-plugins-config-volume\") pod \"2033b2c3-c88c-4085-8de1-040ecbdc7294\" (UID: \"2033b2c3-c88c-4085-8de1-040ecbdc7294\") "
Sep 10 12:34:50.267852 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.267827    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2033b2c3-c88c-4085-8de1-040ecbdc7294-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2033b2c3-c88c-4085-8de1-040ecbdc7294" (UID: "2033b2c3-c88c-4085-8de1-040ecbdc7294"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:34:50.269404 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.269377    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2033b2c3-c88c-4085-8de1-040ecbdc7294-kube-api-access-tcwdx" (OuterVolumeSpecName: "kube-api-access-tcwdx") pod "2033b2c3-c88c-4085-8de1-040ecbdc7294" (UID: "2033b2c3-c88c-4085-8de1-040ecbdc7294"). InnerVolumeSpecName "kube-api-access-tcwdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:34:50.302868 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.302836    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"]
Sep 10 12:34:50.311339 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.311311    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a08ea2-m5sgh"]
Sep 10 12:34:50.363774 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.363585    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:50.368795 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.368742    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcwdx\" (UniqueName: \"kubernetes.io/projected/2033b2c3-c88c-4085-8de1-040ecbdc7294-kube-api-access-tcwdx\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:50.368795 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.368771    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2033b2c3-c88c-4085-8de1-040ecbdc7294-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:34:50.391199 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.391171    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68cd468b-608c-4d19-9b8d-798bc9780ba4" path="/var/lib/kubelet/pods/68cd468b-608c-4d19-9b8d-798bc9780ba4/volumes"
Sep 10 12:34:50.436119 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.436063    2557 generic.go:356] "Generic (PLEG): container finished" podID="2033b2c3-c88c-4085-8de1-040ecbdc7294" containerID="9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a" exitCode=0
Sep 10 12:34:50.436119 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.436105    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"
Sep 10 12:34:50.436243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.436147    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s" event={"ID":"2033b2c3-c88c-4085-8de1-040ecbdc7294","Type":"ContainerDied","Data":"9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a"}
Sep 10 12:34:50.436243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.436197    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s" event={"ID":"2033b2c3-c88c-4085-8de1-040ecbdc7294","Type":"ContainerDied","Data":"a5a537a8826eaa9960817527f734fdec70b7dcdd391b72a7b2440f014408e5d8"}
Sep 10 12:34:50.436243 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.436220    2557 scope.go:117] "RemoveContainer" containerID="9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a"
Sep 10 12:34:50.445495 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.445476    2557 scope.go:117] "RemoveContainer" containerID="9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a"
Sep 10 12:34:50.445802 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:34:50.445784    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a\": container with ID starting with 9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a not found: ID does not exist" containerID="9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a"
Sep 10 12:34:50.445854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.445809    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a"} err="failed to get container status \"9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a\": rpc error: code = NotFound desc = could not find container \"9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a\": container with ID starting with 9000c12bb2b6172bf945b97012d127c55f52a1caae4f9c39d701c1cf2bd48b4a not found: ID does not exist"
Sep 10 12:34:50.485119 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.485083    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"]
Sep 10 12:34:50.494510 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.494480    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s"]
Sep 10 12:34:50.717672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:50.717594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:52.390179 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:52.390148    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2033b2c3-c88c-4085-8de1-040ecbdc7294" path="/var/lib/kubelet/pods/2033b2c3-c88c-4085-8de1-040ecbdc7294/volumes"
Sep 10 12:34:57.085171 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:57.085133    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:57.201458 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:57.201409    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:57.359419 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:57.359391    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:34:57.421834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:57.421805    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:34:57.422634 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:57.422615    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:34:58.649133 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:58.649076    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:42896->10.133.0.72:15021: read: connection reset by peer" start-of-body=
Sep 10 12:34:58.649565 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:58.649159    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:42896->10.133.0.72:15021: read: connection reset by peer"
Sep 10 12:34:59.502653 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:59.502623    2557 generic.go:356] "Generic (PLEG): container finished" podID="4ab18766-3055-4331-9320-5ff3b2484e31" containerID="ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7" exitCode=0
Sep 10 12:34:59.502818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:59.502695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" event={"ID":"4ab18766-3055-4331-9320-5ff3b2484e31","Type":"ContainerDied","Data":"ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"}
Sep 10 12:34:59.503037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:59.503022    2557 scope.go:117] "RemoveContainer" containerID="ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"
Sep 10 12:34:59.504061 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:59.504033    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:34:59.504116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:59.504102    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:34:59.504151 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:34:59.504133    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:35:00.510290 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:00.510258    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" event={"ID":"4ab18766-3055-4331-9320-5ff3b2484e31","Type":"ContainerStarted","Data":"77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88"}
Sep 10 12:35:00.682226 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:00.682187    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:35:00.682587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:00.682564    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 12:35:00.682637 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:00.682616    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 12:35:01.682783 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:01.682750    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 12:35:01.683137 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:01.682816    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 12:35:02.682853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:02.682820    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 12:35:02.683204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:02.682877    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 12:35:03.682946 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:03.682913    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 12:35:03.683310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:03.682971    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 12:35:04.683310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:04.683275    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 10 12:35:04.683710 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:04.683325    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 10 12:35:05.686317 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:05.686289    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:35:05.686661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:05.686630    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:35:05.687186 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:05.687170    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:35:06.928801 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:06.928767    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:09.485167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:09.485084    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:09.623376 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:09.623349    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:12.685821 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:12.685793    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:12.840257 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:12.840231    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:13.951068 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:13.951033    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:14.087122 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:14.087088    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:14.196654 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:14.196624    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:14.716698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:14.716652    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:14.873268 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:14.873240    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:16.263196 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:16.263163    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:17.529416 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:17.529386    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:37.477017 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:37.476982    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:35:49.731309 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:35:49.731274    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:18.203246 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:18.203219    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56_73cab0bc-f1b1-4f63-bdff-4780b53032c8/payload-processing/0.log"
Sep 10 12:36:18.817768 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:18.817741    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:19.158482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.158454    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"]
Sep 10 12:36:19.158865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.158851    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2033b2c3-c88c-4085-8de1-040ecbdc7294" containerName="payload-processing"
Sep 10 12:36:19.158865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.158866    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2033b2c3-c88c-4085-8de1-040ecbdc7294" containerName="payload-processing"
Sep 10 12:36:19.158993 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.158945    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2033b2c3-c88c-4085-8de1-040ecbdc7294" containerName="payload-processing"
Sep 10 12:36:19.161184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.161164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.165186 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.165165    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-47deee-openshift-default-dockercfg-shdz7\""
Sep 10 12:36:19.187273 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"]
Sep 10 12:36:19.187572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cxhk\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-kube-api-access-7cxhk\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187664 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-envoy\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187664 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-istio-token\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187664 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-certs\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-socket\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e99447-b00b-4e18-82a1-75431e976281-istiod-ca-cert\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e99447-b00b-4e18-82a1-75431e976281-istio-podinfo\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187760    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-credential-socket\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.187828 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.187779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-data\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.229873 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.229853    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:19.288327 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288295    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cxhk\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-kube-api-access-7cxhk\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288340    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-envoy\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-istio-token\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288406    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-certs\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-socket\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e99447-b00b-4e18-82a1-75431e976281-istiod-ca-cert\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288522    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e99447-b00b-4e18-82a1-75431e976281-istio-podinfo\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-credential-socket\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-data\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.288877 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288857    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-certs\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.289059 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288957    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-data\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.289059 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.288971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-socket\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.289220 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.289195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-credential-socket\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.289388 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.289251    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e99447-b00b-4e18-82a1-75431e976281-istiod-ca-cert\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.291468 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.291351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-envoy\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.291689 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.291666    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e99447-b00b-4e18-82a1-75431e976281-istio-podinfo\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.306982 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.306964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-istio-token\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.312198 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.312179    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cxhk\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-kube-api-access-7cxhk\") pod \"e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") " pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.422523 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.422450    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:19.471211 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.471188    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:19.758650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.758626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"]
Sep 10 12:36:19.758763 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:36:19.758745    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e99447_b00b_4e18_82a1_75431e976281.slice/crio-f94f641c8998ceefa52427ed6eed9d9293165bfc18e0502a3176a63389dcc918 WatchSource:0}: Error finding container f94f641c8998ceefa52427ed6eed9d9293165bfc18e0502a3176a63389dcc918: Status 404 returned error can't find the container with id f94f641c8998ceefa52427ed6eed9d9293165bfc18e0502a3176a63389dcc918
Sep 10 12:36:19.760920 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.760893    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:36:19.760992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.760950    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:36:19.760992 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.760976    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:36:19.925437 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.925386    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" event={"ID":"60e99447-b00b-4e18-82a1-75431e976281","Type":"ContainerStarted","Data":"49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"}
Sep 10 12:36:19.925610 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.925462    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" event={"ID":"60e99447-b00b-4e18-82a1-75431e976281","Type":"ContainerStarted","Data":"f94f641c8998ceefa52427ed6eed9d9293165bfc18e0502a3176a63389dcc918"}
Sep 10 12:36:19.968778 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:19.968724    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podStartSLOduration=0.968706602 podStartE2EDuration="968.706602ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:36:19.965641072 +0000 UTC m=+1594.059821261" watchObservedRunningTime="2026-09-10 12:36:19.968706602 +0000 UTC m=+1594.062886815"
Sep 10 12:36:20.471380 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:20.471351    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:20.476793 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:20.476772    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:20.930420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:20.930395    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:20.931611 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:20.931594    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:22.041743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:22.041708    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:22.325377 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:22.325311    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:23.553686 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:23.553653    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:23.701393 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:23.701363    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:23.905420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:23.905397    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:24.855167 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:24.855123    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:25.044595 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.044571    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:25.058845 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.058823    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"]
Sep 10 12:36:25.061585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.061570    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.068482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.068239    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-47deee-dockercfg-gccc7\""
Sep 10 12:36:25.068679 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.068664    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-47deee\""
Sep 10 12:36:25.079598 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.079575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"]
Sep 10 12:36:25.133816 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.133793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.133917 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.133826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6kcz\" (UniqueName: \"kubernetes.io/projected/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-kube-api-access-g6kcz\") pod \"payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.235080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.235048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.235080 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.235084    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6kcz\" (UniqueName: \"kubernetes.io/projected/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-kube-api-access-g6kcz\") pod \"payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.235736 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.235715    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.273904 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.273884    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6kcz\" (UniqueName: \"kubernetes.io/projected/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-kube-api-access-g6kcz\") pod \"payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.371542 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.371525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:25.649948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.649924    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"]
Sep 10 12:36:25.651477 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:36:25.651450    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1ada9a_b1d9_4fbd_bec5_7321b6c032a7.slice/crio-0e0e5f89ec8cfd2a89a9392aa1b197cdccda61db6216ddf2ddb677904583af4b WatchSource:0}: Error finding container 0e0e5f89ec8cfd2a89a9392aa1b197cdccda61db6216ddf2ddb677904583af4b: Status 404 returned error can't find the container with id 0e0e5f89ec8cfd2a89a9392aa1b197cdccda61db6216ddf2ddb677904583af4b
Sep 10 12:36:25.958930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.958852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc" event={"ID":"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7","Type":"ContainerStarted","Data":"0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3"}
Sep 10 12:36:25.958930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.958908    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc" event={"ID":"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7","Type":"ContainerStarted","Data":"0e0e5f89ec8cfd2a89a9392aa1b197cdccda61db6216ddf2ddb677904583af4b"}
Sep 10 12:36:25.959368 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:25.959056    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:26.011620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:26.011572    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc" podStartSLOduration=1.011556022 podStartE2EDuration="1.011556022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:36:26.010658792 +0000 UTC m=+1600.104838986" watchObservedRunningTime="2026-09-10 12:36:26.011556022 +0000 UTC m=+1600.105736212"
Sep 10 12:36:36.972613 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:36.972578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:42.052373 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:42.052319    2557 generic.go:356] "Generic (PLEG): container finished" podID="60e99447-b00b-4e18-82a1-75431e976281" containerID="49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258" exitCode=0
Sep 10 12:36:42.052687 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:42.052390    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" event={"ID":"60e99447-b00b-4e18-82a1-75431e976281","Type":"ContainerDied","Data":"49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"}
Sep 10 12:36:42.052781 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:42.052767    2557 scope.go:117] "RemoveContainer" containerID="49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"
Sep 10 12:36:42.053881 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:42.053858    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:36:42.053948 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:42.053921    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:36:42.053990 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:42.053977    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 12:36:43.064573 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:43.064540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" event={"ID":"60e99447-b00b-4e18-82a1-75431e976281","Type":"ContainerStarted","Data":"a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19"}
Sep 10 12:36:43.472245 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:43.472207    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:43.472515 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:43.472493    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 12:36:43.472597 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:43.472540    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 12:36:44.472449 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:44.472400    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 12:36:44.472884 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:44.472482    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 12:36:45.472535 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:45.472494    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 12:36:45.472922 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:45.472563    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 12:36:46.472340 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:46.472298    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 12:36:46.472525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:46.472368    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 12:36:46.637362 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:46.637333    2557 scope.go:117] "RemoveContainer" containerID="8fc36821239487a7384603c2e04a118a389fc7ab5da8b53d72a5bfca6722ef3e"
Sep 10 12:36:46.645911 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:46.645890    2557 scope.go:117] "RemoveContainer" containerID="d92f29c4cc2f85ec630139abe65f462f7bf55b2b6d0d1277133b5447228f5618"
Sep 10 12:36:47.011531 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.011502    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:47.471575 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.471540    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 12:36:47.471851 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.471823    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 12:36:47.781863 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.781780    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"]
Sep 10 12:36:47.785332 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.785311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:47.803803 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.803783    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:36:47.804854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.804838    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:36:47.817375 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.817344    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"]
Sep 10 12:36:47.926071 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:47.926041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c89d822-8dda-45e3-8084-86674709c143-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx\" (UID: \"8c89d822-8dda-45e3-8084-86674709c143\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:48.026584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.026558    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c89d822-8dda-45e3-8084-86674709c143-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx\" (UID: \"8c89d822-8dda-45e3-8084-86674709c143\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:48.027116 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.027089    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c89d822-8dda-45e3-8084-86674709c143-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx\" (UID: \"8c89d822-8dda-45e3-8084-86674709c143\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:48.094926 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.094859    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:48.397657 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:36:48.397628    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c89d822_8dda_45e3_8084_86674709c143.slice/crio-f43e62e8fbc99afd0cbd7a93cba0d4e54e15793086470d782cfa3d8d0f7a6d54 WatchSource:0}: Error finding container f43e62e8fbc99afd0cbd7a93cba0d4e54e15793086470d782cfa3d8d0f7a6d54: Status 404 returned error can't find the container with id f43e62e8fbc99afd0cbd7a93cba0d4e54e15793086470d782cfa3d8d0f7a6d54
Sep 10 12:36:48.397866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.397845    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"]
Sep 10 12:36:48.476031 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.476011    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:48.476466 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.476448    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:48.477177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:48.477155    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:36:49.105144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:49.105115    2557 generic.go:356] "Generic (PLEG): container finished" podID="8c89d822-8dda-45e3-8084-86674709c143" containerID="52d5f22a82cd8a668d055986b0d9200e803e75beb1306b85c5d68f699b0bd4e3" exitCode=0
Sep 10 12:36:49.105442 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:49.105195    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx" event={"ID":"8c89d822-8dda-45e3-8084-86674709c143","Type":"ContainerDied","Data":"52d5f22a82cd8a668d055986b0d9200e803e75beb1306b85c5d68f699b0bd4e3"}
Sep 10 12:36:49.105442 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:49.105243    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx" event={"ID":"8c89d822-8dda-45e3-8084-86674709c143","Type":"ContainerStarted","Data":"f43e62e8fbc99afd0cbd7a93cba0d4e54e15793086470d782cfa3d8d0f7a6d54"}
Sep 10 12:36:50.232584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:50.232562    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:50.345887 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:50.345862    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c89d822-8dda-45e3-8084-86674709c143-maas-api-service-ca\") pod \"8c89d822-8dda-45e3-8084-86674709c143\" (UID: \"8c89d822-8dda-45e3-8084-86674709c143\") "
Sep 10 12:36:50.346154 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:50.346135    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c89d822-8dda-45e3-8084-86674709c143-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c89d822-8dda-45e3-8084-86674709c143" (UID: "8c89d822-8dda-45e3-8084-86674709c143"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:36:50.425392 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:50.425371    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:50.446756 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:50.446738    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c89d822-8dda-45e3-8084-86674709c143-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:36:51.117476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:51.117452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx" event={"ID":"8c89d822-8dda-45e3-8084-86674709c143","Type":"ContainerDied","Data":"f43e62e8fbc99afd0cbd7a93cba0d4e54e15793086470d782cfa3d8d0f7a6d54"}
Sep 10 12:36:51.117476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:51.117472    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"
Sep 10 12:36:51.117616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:51.117490    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f43e62e8fbc99afd0cbd7a93cba0d4e54e15793086470d782cfa3d8d0f7a6d54"
Sep 10 12:36:54.149476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.149443    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:54.190223 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.190189    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"]
Sep 10 12:36:54.190525 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.190484    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc" podUID="7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" containerName="payload-pre-processing" containerID="cri-o://0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3" gracePeriod=30
Sep 10 12:36:54.249895 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.249861    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:54.381341 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.381265    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:54.446715 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.446689    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"]
Sep 10 12:36:54.455612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.455585    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-47deee-5fdmx"]
Sep 10 12:36:54.461140 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.461115    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:54.491009 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.490981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:54.599977 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.599946    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6kcz\" (UniqueName: \"kubernetes.io/projected/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-kube-api-access-g6kcz\") pod \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") "
Sep 10 12:36:54.600128 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.600073    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-plugins-config-volume\") pod \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\" (UID: \"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7\") "
Sep 10 12:36:54.600420 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.600397    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" (UID: "7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:36:54.601815 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.601791    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-kube-api-access-g6kcz" (OuterVolumeSpecName: "kube-api-access-g6kcz") pod "7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" (UID: "7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7"). InnerVolumeSpecName "kube-api-access-g6kcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:36:54.701401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.701348    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6kcz\" (UniqueName: \"kubernetes.io/projected/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-kube-api-access-g6kcz\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:36:54.701401 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.701367    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:36:54.849344 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:54.849323    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:36:55.142545 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.142523    2557 generic.go:356] "Generic (PLEG): container finished" podID="7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" containerID="0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3" exitCode=0
Sep 10 12:36:55.142650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.142570    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"
Sep 10 12:36:55.142650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.142597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc" event={"ID":"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7","Type":"ContainerDied","Data":"0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3"}
Sep 10 12:36:55.142650 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.142634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc" event={"ID":"7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7","Type":"ContainerDied","Data":"0e0e5f89ec8cfd2a89a9392aa1b197cdccda61db6216ddf2ddb677904583af4b"}
Sep 10 12:36:55.142770 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.142655    2557 scope.go:117] "RemoveContainer" containerID="0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3"
Sep 10 12:36:55.152082 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.152062    2557 scope.go:117] "RemoveContainer" containerID="0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3"
Sep 10 12:36:55.152365 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:36:55.152344    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3\": container with ID starting with 0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3 not found: ID does not exist" containerID="0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3"
Sep 10 12:36:55.152405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.152373    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3"} err="failed to get container status \"0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3\": rpc error: code = NotFound desc = could not find container \"0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3\": container with ID starting with 0f1e8c4e1545f3ef430272032b24e33936485629393bf93e9791b21df8c52ae3 not found: ID does not exist"
Sep 10 12:36:55.171300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.171274    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"]
Sep 10 12:36:55.174144 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:55.174125    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc"]
Sep 10 12:36:56.389203 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:56.389179    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" path="/var/lib/kubelet/pods/7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7/volumes"
Sep 10 12:36:56.389533 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:36:56.389484    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c89d822-8dda-45e3-8084-86674709c143" path="/var/lib/kubelet/pods/8c89d822-8dda-45e3-8084-86674709c143/volumes"
Sep 10 12:37:01.442034 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:01.441993    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:01.729994 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:01.729917    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:01.784761 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:01.784730    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"]
Sep 10 12:37:01.784930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:01.784909    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" containerID="cri-o://a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19" gracePeriod=30
Sep 10 12:37:01.909966 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:01.909929    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:03.478204 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:03.478167    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 12:37:03.478569 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:03.478231    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 12:37:05.486067 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486036    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"]
Sep 10 12:37:05.486441 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486414    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" containerName="payload-pre-processing"
Sep 10 12:37:05.486491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486450    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" containerName="payload-pre-processing"
Sep 10 12:37:05.486491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486460    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89d822-8dda-45e3-8084-86674709c143" containerName="revoke-keys"
Sep 10 12:37:05.486491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486465    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89d822-8dda-45e3-8084-86674709c143" containerName="revoke-keys"
Sep 10 12:37:05.486585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486527    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1ada9a-b1d9-4fbd-bec5-7321b6c032a7" containerName="payload-pre-processing"
Sep 10 12:37:05.486585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.486535    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c89d822-8dda-45e3-8084-86674709c143" containerName="revoke-keys"
Sep 10 12:37:05.492255 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.491278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:05.495377 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.495355    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:37:05.495660 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.495641    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:37:05.503775 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.503755    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"]
Sep 10 12:37:05.593698 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.593667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68485be3-9ad5-431c-97b5-98c761f4ab95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k\" (UID: \"68485be3-9ad5-431c-97b5-98c761f4ab95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:05.670115 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.670092    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:05.694395 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.694370    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68485be3-9ad5-431c-97b5-98c761f4ab95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k\" (UID: \"68485be3-9ad5-431c-97b5-98c761f4ab95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:05.694896 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.694877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68485be3-9ad5-431c-97b5-98c761f4ab95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k\" (UID: \"68485be3-9ad5-431c-97b5-98c761f4ab95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:05.804470 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:05.804383    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:06.077070 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:37:06.077042    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68485be3_9ad5_431c_97b5_98c761f4ab95.slice/crio-e9f7317b198b56e4a5b5c88c14a4627ed319dee6326e6d21f6f2c316005895a0 WatchSource:0}: Error finding container e9f7317b198b56e4a5b5c88c14a4627ed319dee6326e6d21f6f2c316005895a0: Status 404 returned error can't find the container with id e9f7317b198b56e4a5b5c88c14a4627ed319dee6326e6d21f6f2c316005895a0
Sep 10 12:37:06.077936 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:06.077910    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"]
Sep 10 12:37:06.201906 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:06.201882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k" event={"ID":"68485be3-9ad5-431c-97b5-98c761f4ab95","Type":"ContainerStarted","Data":"e9f7317b198b56e4a5b5c88c14a4627ed319dee6326e6d21f6f2c316005895a0"}
Sep 10 12:37:07.026124 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.026104    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:37:07.107045 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107018    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e99447-b00b-4e18-82a1-75431e976281-istiod-ca-cert\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107055    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-certs\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107172 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107087    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-envoy\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107204    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-data\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107229    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-credential-socket\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107282 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107247    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-socket\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107309    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:37:07.107462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107330    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-istio-token\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107462 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107356    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cxhk\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-kube-api-access-7cxhk\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107463    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e99447-b00b-4e18-82a1-75431e976281-istio-podinfo\") pod \"60e99447-b00b-4e18-82a1-75431e976281\" (UID: \"60e99447-b00b-4e18-82a1-75431e976281\") "
Sep 10 12:37:07.107616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107489    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-data" (OuterVolumeSpecName: "istio-data") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:37:07.107616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107509    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:37:07.107616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107535    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e99447-b00b-4e18-82a1-75431e976281-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:07.107616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107546    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:37:07.107865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107787    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60e99447-b00b-4e18-82a1-75431e976281-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.107865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107808    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.107865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107823    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.107865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107835    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.107865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.107846    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.109164 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.109147    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:37:07.109318 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.109299    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-istio-token" (OuterVolumeSpecName: "istio-token") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:37:07.109647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.109623    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60e99447-b00b-4e18-82a1-75431e976281-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:37:07.109730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.109650    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-kube-api-access-7cxhk" (OuterVolumeSpecName: "kube-api-access-7cxhk") pod "60e99447-b00b-4e18-82a1-75431e976281" (UID: "60e99447-b00b-4e18-82a1-75431e976281"). InnerVolumeSpecName "kube-api-access-7cxhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:37:07.208300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.208249    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60e99447-b00b-4e18-82a1-75431e976281-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.208300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.208267    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60e99447-b00b-4e18-82a1-75431e976281-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.208300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.208276    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.208300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.208286    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cxhk\" (UniqueName: \"kubernetes.io/projected/60e99447-b00b-4e18-82a1-75431e976281-kube-api-access-7cxhk\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:07.209621 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.209599    2557 generic.go:356] "Generic (PLEG): container finished" podID="60e99447-b00b-4e18-82a1-75431e976281" containerID="a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19" exitCode=0
Sep 10 12:37:07.209718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.209644    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"
Sep 10 12:37:07.209718 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.209686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" event={"ID":"60e99447-b00b-4e18-82a1-75431e976281","Type":"ContainerDied","Data":"a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19"}
Sep 10 12:37:07.209837 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.209745    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv" event={"ID":"60e99447-b00b-4e18-82a1-75431e976281","Type":"ContainerDied","Data":"f94f641c8998ceefa52427ed6eed9d9293165bfc18e0502a3176a63389dcc918"}
Sep 10 12:37:07.209837 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.209776    2557 scope.go:117] "RemoveContainer" containerID="a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19"
Sep 10 12:37:07.211319 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.211296    2557 generic.go:356] "Generic (PLEG): container finished" podID="68485be3-9ad5-431c-97b5-98c761f4ab95" containerID="c65756aa6a34f21dcc656d110d243d6abb49dff331e213040d2d28c462bb22e9" exitCode=0
Sep 10 12:37:07.211403 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.211378    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k" event={"ID":"68485be3-9ad5-431c-97b5-98c761f4ab95","Type":"ContainerDied","Data":"c65756aa6a34f21dcc656d110d243d6abb49dff331e213040d2d28c462bb22e9"}
Sep 10 12:37:07.219060 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.219044    2557 scope.go:117] "RemoveContainer" containerID="49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"
Sep 10 12:37:07.227521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.227501    2557 scope.go:117] "RemoveContainer" containerID="a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19"
Sep 10 12:37:07.227762 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:37:07.227745    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19\": container with ID starting with a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19 not found: ID does not exist" containerID="a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19"
Sep 10 12:37:07.227820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.227770    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19"} err="failed to get container status \"a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19\": rpc error: code = NotFound desc = could not find container \"a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19\": container with ID starting with a48093324eafadb53c82f2adf078dc19e155ee4133d55324bcf988b18feafe19 not found: ID does not exist"
Sep 10 12:37:07.227820 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.227786    2557 scope.go:117] "RemoveContainer" containerID="49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"
Sep 10 12:37:07.228071 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:37:07.228052    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258\": container with ID starting with 49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258 not found: ID does not exist" containerID="49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"
Sep 10 12:37:07.228129 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.228080    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258"} err="failed to get container status \"49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258\": rpc error: code = NotFound desc = could not find container \"49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258\": container with ID starting with 49eb9c9cb008a401f6b734d716a17778caf3ae899767ad8feb3ba5213bdb0258 not found: ID does not exist"
Sep 10 12:37:07.273778 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.273754    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"]
Sep 10 12:37:07.286709 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:07.286687    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv"]
Sep 10 12:37:08.345704 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:08.345683    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:08.389272 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:08.389249    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e99447-b00b-4e18-82a1-75431e976281" path="/var/lib/kubelet/pods/60e99447-b00b-4e18-82a1-75431e976281/volumes"
Sep 10 12:37:08.417336 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:08.417316    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68485be3-9ad5-431c-97b5-98c761f4ab95-maas-api-service-ca\") pod \"68485be3-9ad5-431c-97b5-98c761f4ab95\" (UID: \"68485be3-9ad5-431c-97b5-98c761f4ab95\") "
Sep 10 12:37:08.417640 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:08.417611    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68485be3-9ad5-431c-97b5-98c761f4ab95-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68485be3-9ad5-431c-97b5-98c761f4ab95" (UID: "68485be3-9ad5-431c-97b5-98c761f4ab95"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:08.417755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:08.417689    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68485be3-9ad5-431c-97b5-98c761f4ab95-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:09.224780 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:09.224750    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k" event={"ID":"68485be3-9ad5-431c-97b5-98c761f4ab95","Type":"ContainerDied","Data":"e9f7317b198b56e4a5b5c88c14a4627ed319dee6326e6d21f6f2c316005895a0"}
Sep 10 12:37:09.224912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:09.224824    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9f7317b198b56e4a5b5c88c14a4627ed319dee6326e6d21f6f2c316005895a0"
Sep 10 12:37:09.224912 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:09.224765    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"
Sep 10 12:37:21.237182 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.237148    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:21.271899 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.271872    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"]
Sep 10 12:37:21.272092 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.272070    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56" podUID="73cab0bc-f1b1-4f63-bdff-4780b53032c8" containerName="payload-processing" containerID="cri-o://316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205" gracePeriod=30
Sep 10 12:37:21.299014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.298991    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"]
Sep 10 12:37:21.299197 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.299179    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2" podUID="1cd58070-5cc3-42a4-81c1-49e62d789c67" containerName="payload-pre-processing" containerID="cri-o://f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918" gracePeriod=30
Sep 10 12:37:21.368159 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.368137    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:21.500850 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.500772    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:21.555208 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.555184    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:37:21.558044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.558027    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.649724    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfhh4\" (UniqueName: \"kubernetes.io/projected/73cab0bc-f1b1-4f63-bdff-4780b53032c8-kube-api-access-qfhh4\") pod \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") "
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.649795    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvxvk\" (UniqueName: \"kubernetes.io/projected/1cd58070-5cc3-42a4-81c1-49e62d789c67-kube-api-access-dvxvk\") pod \"1cd58070-5cc3-42a4-81c1-49e62d789c67\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") "
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.649876    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cd58070-5cc3-42a4-81c1-49e62d789c67-plugins-config-volume\") pod \"1cd58070-5cc3-42a4-81c1-49e62d789c67\" (UID: \"1cd58070-5cc3-42a4-81c1-49e62d789c67\") "
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.649947    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73cab0bc-f1b1-4f63-bdff-4780b53032c8-plugins-config-volume\") pod \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\" (UID: \"73cab0bc-f1b1-4f63-bdff-4780b53032c8\") "
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.650947    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd58070-5cc3-42a4-81c1-49e62d789c67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1cd58070-5cc3-42a4-81c1-49e62d789c67" (UID: "1cd58070-5cc3-42a4-81c1-49e62d789c67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.651304    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"]
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.651359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73cab0bc-f1b1-4f63-bdff-4780b53032c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "73cab0bc-f1b1-4f63-bdff-4780b53032c8" (UID: "73cab0bc-f1b1-4f63-bdff-4780b53032c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.656635    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73cab0bc-f1b1-4f63-bdff-4780b53032c8-kube-api-access-qfhh4" (OuterVolumeSpecName: "kube-api-access-qfhh4") pod "73cab0bc-f1b1-4f63-bdff-4780b53032c8" (UID: "73cab0bc-f1b1-4f63-bdff-4780b53032c8"). InnerVolumeSpecName "kube-api-access-qfhh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:37:21.656834 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.656665    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd58070-5cc3-42a4-81c1-49e62d789c67-kube-api-access-dvxvk" (OuterVolumeSpecName: "kube-api-access-dvxvk") pod "1cd58070-5cc3-42a4-81c1-49e62d789c67" (UID: "1cd58070-5cc3-42a4-81c1-49e62d789c67"). InnerVolumeSpecName "kube-api-access-dvxvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:37:21.670384 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.669068    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-3db7ea-8jn6k"]
Sep 10 12:37:21.672806 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.672777    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:21.751139 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.751066    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvxvk\" (UniqueName: \"kubernetes.io/projected/1cd58070-5cc3-42a4-81c1-49e62d789c67-kube-api-access-dvxvk\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:21.751139 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.751088    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cd58070-5cc3-42a4-81c1-49e62d789c67-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:21.751139 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.751107    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73cab0bc-f1b1-4f63-bdff-4780b53032c8-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:21.751139 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.751115    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfhh4\" (UniqueName: \"kubernetes.io/projected/73cab0bc-f1b1-4f63-bdff-4780b53032c8-kube-api-access-qfhh4\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:37:21.827819 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:21.827790    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:22.017806 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.017728    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:22.298706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.298643    2557 generic.go:356] "Generic (PLEG): container finished" podID="73cab0bc-f1b1-4f63-bdff-4780b53032c8" containerID="316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205" exitCode=0
Sep 10 12:37:22.298706 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.298683    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"
Sep 10 12:37:22.299132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.298682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56" event={"ID":"73cab0bc-f1b1-4f63-bdff-4780b53032c8","Type":"ContainerDied","Data":"316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205"}
Sep 10 12:37:22.299132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.298807    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56" event={"ID":"73cab0bc-f1b1-4f63-bdff-4780b53032c8","Type":"ContainerDied","Data":"0caaa79f385183f4ca2bc5a25c96f255c33ce738ea72edf7e66c923a88e9ce4c"}
Sep 10 12:37:22.299132 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.298829    2557 scope.go:117] "RemoveContainer" containerID="316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205"
Sep 10 12:37:22.300298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.300105    2557 generic.go:356] "Generic (PLEG): container finished" podID="1cd58070-5cc3-42a4-81c1-49e62d789c67" containerID="f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918" exitCode=0
Sep 10 12:37:22.300298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.300135    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"
Sep 10 12:37:22.300298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.300188    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2" event={"ID":"1cd58070-5cc3-42a4-81c1-49e62d789c67","Type":"ContainerDied","Data":"f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918"}
Sep 10 12:37:22.300298 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.300235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2" event={"ID":"1cd58070-5cc3-42a4-81c1-49e62d789c67","Type":"ContainerDied","Data":"0ee8ba83432025732da55742e7efb92ef5ff76a48ebc28c0744a784a6ce6152c"}
Sep 10 12:37:22.309528 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.309515    2557 scope.go:117] "RemoveContainer" containerID="316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205"
Sep 10 12:37:22.309822 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:37:22.309781    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205\": container with ID starting with 316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205 not found: ID does not exist" containerID="316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205"
Sep 10 12:37:22.309888 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.309814    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205"} err="failed to get container status \"316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205\": rpc error: code = NotFound desc = could not find container \"316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205\": container with ID starting with 316beee67265e4577dcb57faffa9c387212e9e3ffa67c6bcac2e8eb04b63f205 not found: ID does not exist"
Sep 10 12:37:22.309888 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.309835    2557 scope.go:117] "RemoveContainer" containerID="f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918"
Sep 10 12:37:22.317267 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.317241    2557 scope.go:117] "RemoveContainer" containerID="f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918"
Sep 10 12:37:22.317520 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:37:22.317504    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918\": container with ID starting with f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918 not found: ID does not exist" containerID="f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918"
Sep 10 12:37:22.317585 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.317526    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918"} err="failed to get container status \"f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918\": rpc error: code = NotFound desc = could not find container \"f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918\": container with ID starting with f9ddaf8092c2f6517f0949c793a6dde69d1dff16c1e10dd9402b2b0b8916b918 not found: ID does not exist"
Sep 10 12:37:22.329704 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.329684    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"]
Sep 10 12:37:22.338831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.338810    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56"]
Sep 10 12:37:22.362605 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.362583    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"]
Sep 10 12:37:22.370480 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.370462    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2"]
Sep 10 12:37:22.389670 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.389649    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd58070-5cc3-42a4-81c1-49e62d789c67" path="/var/lib/kubelet/pods/1cd58070-5cc3-42a4-81c1-49e62d789c67/volumes"
Sep 10 12:37:22.389987 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.389969    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68485be3-9ad5-431c-97b5-98c761f4ab95" path="/var/lib/kubelet/pods/68485be3-9ad5-431c-97b5-98c761f4ab95/volumes"
Sep 10 12:37:22.390327 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:22.390311    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73cab0bc-f1b1-4f63-bdff-4780b53032c8" path="/var/lib/kubelet/pods/73cab0bc-f1b1-4f63-bdff-4780b53032c8/volumes"
Sep 10 12:37:27.067799 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:27.067769    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:37:49.295010 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:37:49.294981    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:03.401573 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:03.401538    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:04.370383 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:04.370353    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:10.341588 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.341516    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:10.442832 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.442799    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:10.591883 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.591807    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"]
Sep 10 12:38:10.592036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.592003    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy" containerID="cri-o://77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88" gracePeriod=30
Sep 10 12:38:10.679310 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.679280    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:10.963782 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.963752    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"]
Sep 10 12:38:10.964135 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964122    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd58070-5cc3-42a4-81c1-49e62d789c67" containerName="payload-pre-processing"
Sep 10 12:38:10.964191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964137    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd58070-5cc3-42a4-81c1-49e62d789c67" containerName="payload-pre-processing"
Sep 10 12:38:10.964191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964153    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68485be3-9ad5-431c-97b5-98c761f4ab95" containerName="revoke-keys"
Sep 10 12:38:10.964191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964158    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="68485be3-9ad5-431c-97b5-98c761f4ab95" containerName="revoke-keys"
Sep 10 12:38:10.964191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964166    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73cab0bc-f1b1-4f63-bdff-4780b53032c8" containerName="payload-processing"
Sep 10 12:38:10.964191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964171    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="73cab0bc-f1b1-4f63-bdff-4780b53032c8" containerName="payload-processing"
Sep 10 12:38:10.964191 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964191    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964197    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964204    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964209    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964267    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="68485be3-9ad5-431c-97b5-98c761f4ab95" containerName="revoke-keys"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964274    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd58070-5cc3-42a4-81c1-49e62d789c67" containerName="payload-pre-processing"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964282    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="73cab0bc-f1b1-4f63-bdff-4780b53032c8" containerName="payload-processing"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964287    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy"
Sep 10 12:38:10.964381 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.964293    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e99447-b00b-4e18-82a1-75431e976281" containerName="istio-proxy"
Sep 10 12:38:10.966183 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.966168    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:10.968852 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.968824    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:38:10.969091 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.969078    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:38:10.975894 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:10.975871    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"]
Sep 10 12:38:11.018690 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.018667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34f85c2-749d-4b5e-88d6-18a0f02b8268-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w\" (UID: \"d34f85c2-749d-4b5e-88d6-18a0f02b8268\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:11.120036 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.120014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34f85c2-749d-4b5e-88d6-18a0f02b8268-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w\" (UID: \"d34f85c2-749d-4b5e-88d6-18a0f02b8268\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:11.120575 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.120560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34f85c2-749d-4b5e-88d6-18a0f02b8268-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w\" (UID: \"d34f85c2-749d-4b5e-88d6-18a0f02b8268\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:11.166349 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.166327    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:11.277625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.277549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:11.546981 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.546950    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"]
Sep 10 12:38:11.548491 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:38:11.548461    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34f85c2_749d_4b5e_88d6_18a0f02b8268.slice/crio-0ae3a97976a143bbaf9ac7bf3e72b13a9304cfbb98d2587acb550bc9eca0c1ed WatchSource:0}: Error finding container 0ae3a97976a143bbaf9ac7bf3e72b13a9304cfbb98d2587acb550bc9eca0c1ed: Status 404 returned error can't find the container with id 0ae3a97976a143bbaf9ac7bf3e72b13a9304cfbb98d2587acb550bc9eca0c1ed
Sep 10 12:38:11.565352 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:11.565319    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w" event={"ID":"d34f85c2-749d-4b5e-88d6-18a0f02b8268","Type":"ContainerStarted","Data":"0ae3a97976a143bbaf9ac7bf3e72b13a9304cfbb98d2587acb550bc9eca0c1ed"}
Sep 10 12:38:12.571874 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:12.571805    2557 generic.go:356] "Generic (PLEG): container finished" podID="d34f85c2-749d-4b5e-88d6-18a0f02b8268" containerID="442ce0272cb09a628c16b807623a7fd4a0851133a4ba6f9bbbeb0eb913230bc6" exitCode=0
Sep 10 12:38:12.572163 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:12.571888    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w" event={"ID":"d34f85c2-749d-4b5e-88d6-18a0f02b8268","Type":"ContainerDied","Data":"442ce0272cb09a628c16b807623a7fd4a0851133a4ba6f9bbbeb0eb913230bc6"}
Sep 10 12:38:13.701004 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:13.700982    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:13.737559 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:13.737535    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34f85c2-749d-4b5e-88d6-18a0f02b8268-maas-api-service-ca\") pod \"d34f85c2-749d-4b5e-88d6-18a0f02b8268\" (UID: \"d34f85c2-749d-4b5e-88d6-18a0f02b8268\") "
Sep 10 12:38:13.737854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:13.737831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34f85c2-749d-4b5e-88d6-18a0f02b8268-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d34f85c2-749d-4b5e-88d6-18a0f02b8268" (UID: "d34f85c2-749d-4b5e-88d6-18a0f02b8268"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:13.838903 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:13.838849    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34f85c2-749d-4b5e-88d6-18a0f02b8268-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:14.584258 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:14.584232    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"
Sep 10 12:38:14.584393 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:14.584267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w" event={"ID":"d34f85c2-749d-4b5e-88d6-18a0f02b8268","Type":"ContainerDied","Data":"0ae3a97976a143bbaf9ac7bf3e72b13a9304cfbb98d2587acb550bc9eca0c1ed"}
Sep 10 12:38:14.584393 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:14.584313    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ae3a97976a143bbaf9ac7bf3e72b13a9304cfbb98d2587acb550bc9eca0c1ed"
Sep 10 12:38:15.826504 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.826483    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:38:15.955881 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.955861    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-istio-token\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.955995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.955905    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-data\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.955995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.955936    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-socket\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.955995 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.955974    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdz47\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-kube-api-access-zdz47\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.956110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956022    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab18766-3055-4331-9320-5ff3b2484e31-istio-podinfo\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.956110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956060    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-credential-socket\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.956110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab18766-3055-4331-9320-5ff3b2484e31-istiod-ca-cert\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.956256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956160    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-certs\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.956256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956181    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:15.956256 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956208    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-envoy\") pod \"4ab18766-3055-4331-9320-5ff3b2484e31\" (UID: \"4ab18766-3055-4331-9320-5ff3b2484e31\") "
Sep 10 12:38:15.956398 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956258    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:15.956398 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956344    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:15.956530 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956493    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:15.956571 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956544    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab18766-3055-4331-9320-5ff3b2484e31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:15.956643 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956626    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:15.956678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956649    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:15.956678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956664    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab18766-3055-4331-9320-5ff3b2484e31-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:15.956678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956676    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:15.956809 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.956687    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:15.958025 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.958004    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:15.958131 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.958106    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ab18766-3055-4331-9320-5ff3b2484e31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:38:15.958193 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.958141    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-kube-api-access-zdz47" (OuterVolumeSpecName: "kube-api-access-zdz47") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "kube-api-access-zdz47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:15.958306 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:15.958291    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ab18766-3055-4331-9320-5ff3b2484e31" (UID: "4ab18766-3055-4331-9320-5ff3b2484e31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:16.057414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.057387    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab18766-3055-4331-9320-5ff3b2484e31-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:16.057414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.057415    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:16.057548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.057450    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdz47\" (UniqueName: \"kubernetes.io/projected/4ab18766-3055-4331-9320-5ff3b2484e31-kube-api-access-zdz47\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:16.057548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.057464    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab18766-3055-4331-9320-5ff3b2484e31-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:16.597755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.597729    2557 generic.go:356] "Generic (PLEG): container finished" podID="4ab18766-3055-4331-9320-5ff3b2484e31" containerID="77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88" exitCode=0
Sep 10 12:38:16.597854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.597765    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"
Sep 10 12:38:16.597854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.597785    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" event={"ID":"4ab18766-3055-4331-9320-5ff3b2484e31","Type":"ContainerDied","Data":"77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88"}
Sep 10 12:38:16.597854 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.597832    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf" event={"ID":"4ab18766-3055-4331-9320-5ff3b2484e31","Type":"ContainerDied","Data":"00f7c72fbe3e3d16caa3a0c38a95ca72042f95c253649387bd67d23842cec10b"}
Sep 10 12:38:16.598075 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.597862    2557 scope.go:117] "RemoveContainer" containerID="77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88"
Sep 10 12:38:16.606703 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.606687    2557 scope.go:117] "RemoveContainer" containerID="ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"
Sep 10 12:38:16.614123 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.614101    2557 scope.go:117] "RemoveContainer" containerID="77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88"
Sep 10 12:38:16.614436 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:38:16.614392    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88\": container with ID starting with 77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88 not found: ID does not exist" containerID="77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88"
Sep 10 12:38:16.614559 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.614420    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88"} err="failed to get container status \"77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88\": rpc error: code = NotFound desc = could not find container \"77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88\": container with ID starting with 77749f331339763e18799af0a0645807e283ff69cfe3a5bde1b36ee947575e88 not found: ID does not exist"
Sep 10 12:38:16.614559 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.614461    2557 scope.go:117] "RemoveContainer" containerID="ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"
Sep 10 12:38:16.615237 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:38:16.615218    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7\": container with ID starting with ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7 not found: ID does not exist" containerID="ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"
Sep 10 12:38:16.615311 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.615243    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7"} err="failed to get container status \"ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7\": rpc error: code = NotFound desc = could not find container \"ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7\": container with ID starting with ccc902dbe917ba3c2086363c2a0081ca4d3391aa88af342b8ccb8d2796fac0d7 not found: ID does not exist"
Sep 10 12:38:16.618259 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.618240    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"]
Sep 10 12:38:16.621408 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:16.621388    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf"]
Sep 10 12:38:17.410041 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:17.410015    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:18.389950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:18.389919    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" path="/var/lib/kubelet/pods/4ab18766-3055-4331-9320-5ff3b2484e31/volumes"
Sep 10 12:38:21.196479 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:21.196444    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:21.939999 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:21.939960    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:22.026518 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:22.026475    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:22.079990 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:22.079965    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"]
Sep 10 12:38:22.087402 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:22.087377    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a5be11-vns2w"]
Sep 10 12:38:22.128110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:22.128086    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:22.390213 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:22.390175    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34f85c2-749d-4b5e-88d6-18a0f02b8268" path="/var/lib/kubelet/pods/d34f85c2-749d-4b5e-88d6-18a0f02b8268/volumes"
Sep 10 12:38:22.471962 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:22.471935    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:28.657052 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:28.657018    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:28.723620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:28.723594    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:28.926534 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:28.926452    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:29.237192 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237114    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"]
Sep 10 12:38:29.237521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237507    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy"
Sep 10 12:38:29.237570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237523    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy"
Sep 10 12:38:29.237570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237537    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34f85c2-749d-4b5e-88d6-18a0f02b8268" containerName="revoke-keys"
Sep 10 12:38:29.237570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237543    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34f85c2-749d-4b5e-88d6-18a0f02b8268" containerName="revoke-keys"
Sep 10 12:38:29.237570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237552    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy"
Sep 10 12:38:29.237570 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237557    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy"
Sep 10 12:38:29.237723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237616    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy"
Sep 10 12:38:29.237723 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.237624    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34f85c2-749d-4b5e-88d6-18a0f02b8268" containerName="revoke-keys"
Sep 10 12:38:29.240742 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.240726    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:29.243552 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.243530    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:38:29.243642 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.243574    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:38:29.249387 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.249360    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"]
Sep 10 12:38:29.344947 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.344923    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:29.364560 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.364533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1349f1e5-26bc-48ed-a935-c10c6bbf0095-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722\" (UID: \"1349f1e5-26bc-48ed-a935-c10c6bbf0095\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:29.465288 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.465249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1349f1e5-26bc-48ed-a935-c10c6bbf0095-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722\" (UID: \"1349f1e5-26bc-48ed-a935-c10c6bbf0095\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:29.465850 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.465832    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1349f1e5-26bc-48ed-a935-c10c6bbf0095-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722\" (UID: \"1349f1e5-26bc-48ed-a935-c10c6bbf0095\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:29.552011 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.551958    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:29.827014 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:29.826991    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"]
Sep 10 12:38:29.828417 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:38:29.828391    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1349f1e5_26bc_48ed_a935_c10c6bbf0095.slice/crio-231d2b875c4d74b620e189957c92ab515688d02b556b8be5bb809a2add2fdd22 WatchSource:0}: Error finding container 231d2b875c4d74b620e189957c92ab515688d02b556b8be5bb809a2add2fdd22: Status 404 returned error can't find the container with id 231d2b875c4d74b620e189957c92ab515688d02b556b8be5bb809a2add2fdd22
Sep 10 12:38:30.672033 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:30.672000    2557 generic.go:356] "Generic (PLEG): container finished" podID="1349f1e5-26bc-48ed-a935-c10c6bbf0095" containerID="9315e586e7b7e8c2143c4e5a79f20350bbed626aff34d05e01fbed7ec5d36142" exitCode=0
Sep 10 12:38:30.672113 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:30.672086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722" event={"ID":"1349f1e5-26bc-48ed-a935-c10c6bbf0095","Type":"ContainerDied","Data":"9315e586e7b7e8c2143c4e5a79f20350bbed626aff34d05e01fbed7ec5d36142"}
Sep 10 12:38:30.672158 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:30.672137    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722" event={"ID":"1349f1e5-26bc-48ed-a935-c10c6bbf0095","Type":"ContainerStarted","Data":"231d2b875c4d74b620e189957c92ab515688d02b556b8be5bb809a2add2fdd22"}
Sep 10 12:38:31.797612 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:31.797590    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:31.883512 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:31.883486    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1349f1e5-26bc-48ed-a935-c10c6bbf0095-maas-api-service-ca\") pod \"1349f1e5-26bc-48ed-a935-c10c6bbf0095\" (UID: \"1349f1e5-26bc-48ed-a935-c10c6bbf0095\") "
Sep 10 12:38:31.883804 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:31.883781    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1349f1e5-26bc-48ed-a935-c10c6bbf0095-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1349f1e5-26bc-48ed-a935-c10c6bbf0095" (UID: "1349f1e5-26bc-48ed-a935-c10c6bbf0095"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:31.984750 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:31.984686    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1349f1e5-26bc-48ed-a935-c10c6bbf0095-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:32.683355 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:32.683300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722" event={"ID":"1349f1e5-26bc-48ed-a935-c10c6bbf0095","Type":"ContainerDied","Data":"231d2b875c4d74b620e189957c92ab515688d02b556b8be5bb809a2add2fdd22"}
Sep 10 12:38:32.683355 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:32.683332    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"
Sep 10 12:38:32.683491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:32.683338    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="231d2b875c4d74b620e189957c92ab515688d02b556b8be5bb809a2add2fdd22"
Sep 10 12:38:39.752300 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.752260    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"]
Sep 10 12:38:39.759707 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.759678    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-18c2d2-29817390-7kjgv"]
Sep 10 12:38:39.773809 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.773787    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:39.806479 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.806451    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"]
Sep 10 12:38:39.806755 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.806726    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4" podUID="a7660833-3eb2-414e-b7f9-36c2d5102e88" containerName="payload-processing" containerID="cri-o://bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c" gracePeriod=30
Sep 10 12:38:39.813166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.813145    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"]
Sep 10 12:38:39.814264 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.813530    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj" podUID="202dd0f9-3509-431b-ab58-7323b91f35aa" containerName="payload-pre-processing" containerID="cri-o://38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c" gracePeriod=30
Sep 10 12:38:39.860148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.860125    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:39.960399 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.960366    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:39.989713 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.989681    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"]
Sep 10 12:38:39.993934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:39.993905    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-18c2d2-x8722"]
Sep 10 12:38:40.027866 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.027840    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:40.094177 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.093983    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:38:40.096078 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.096052    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:38:40.247109 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.247081    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202dd0f9-3509-431b-ab58-7323b91f35aa-plugins-config-volume\") pod \"202dd0f9-3509-431b-ab58-7323b91f35aa\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") "
Sep 10 12:38:40.247265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.247162    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7660833-3eb2-414e-b7f9-36c2d5102e88-plugins-config-volume\") pod \"a7660833-3eb2-414e-b7f9-36c2d5102e88\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") "
Sep 10 12:38:40.247265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.247183    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m9f4\" (UniqueName: \"kubernetes.io/projected/a7660833-3eb2-414e-b7f9-36c2d5102e88-kube-api-access-7m9f4\") pod \"a7660833-3eb2-414e-b7f9-36c2d5102e88\" (UID: \"a7660833-3eb2-414e-b7f9-36c2d5102e88\") "
Sep 10 12:38:40.247265 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.247218    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv8dc\" (UniqueName: \"kubernetes.io/projected/202dd0f9-3509-431b-ab58-7323b91f35aa-kube-api-access-tv8dc\") pod \"202dd0f9-3509-431b-ab58-7323b91f35aa\" (UID: \"202dd0f9-3509-431b-ab58-7323b91f35aa\") "
Sep 10 12:38:40.247538 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.247499    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/202dd0f9-3509-431b-ab58-7323b91f35aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "202dd0f9-3509-431b-ab58-7323b91f35aa" (UID: "202dd0f9-3509-431b-ab58-7323b91f35aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:40.247538 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.247503    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7660833-3eb2-414e-b7f9-36c2d5102e88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a7660833-3eb2-414e-b7f9-36c2d5102e88" (UID: "a7660833-3eb2-414e-b7f9-36c2d5102e88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:40.249165 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.249142    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/202dd0f9-3509-431b-ab58-7323b91f35aa-kube-api-access-tv8dc" (OuterVolumeSpecName: "kube-api-access-tv8dc") pod "202dd0f9-3509-431b-ab58-7323b91f35aa" (UID: "202dd0f9-3509-431b-ab58-7323b91f35aa"). InnerVolumeSpecName "kube-api-access-tv8dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:40.249236 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.249184    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7660833-3eb2-414e-b7f9-36c2d5102e88-kube-api-access-7m9f4" (OuterVolumeSpecName: "kube-api-access-7m9f4") pod "a7660833-3eb2-414e-b7f9-36c2d5102e88" (UID: "a7660833-3eb2-414e-b7f9-36c2d5102e88"). InnerVolumeSpecName "kube-api-access-7m9f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:40.348460 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.348387    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7660833-3eb2-414e-b7f9-36c2d5102e88-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:40.348460 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.348406    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m9f4\" (UniqueName: \"kubernetes.io/projected/a7660833-3eb2-414e-b7f9-36c2d5102e88-kube-api-access-7m9f4\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:40.348460 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.348416    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv8dc\" (UniqueName: \"kubernetes.io/projected/202dd0f9-3509-431b-ab58-7323b91f35aa-kube-api-access-tv8dc\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:40.348460 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.348435    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/202dd0f9-3509-431b-ab58-7323b91f35aa-plugins-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:40.353934 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.353911    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:40.389738 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.389715    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1349f1e5-26bc-48ed-a935-c10c6bbf0095" path="/var/lib/kubelet/pods/1349f1e5-26bc-48ed-a935-c10c6bbf0095/volumes"
Sep 10 12:38:40.389980 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.389967    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="176f64b3-b78d-4e20-b32f-161465cc887c" path="/var/lib/kubelet/pods/176f64b3-b78d-4e20-b32f-161465cc887c/volumes"
Sep 10 12:38:40.731700 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.731678    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7660833-3eb2-414e-b7f9-36c2d5102e88" containerID="bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c" exitCode=0
Sep 10 12:38:40.731798 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.731715    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"
Sep 10 12:38:40.731798 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.731765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4" event={"ID":"a7660833-3eb2-414e-b7f9-36c2d5102e88","Type":"ContainerDied","Data":"bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c"}
Sep 10 12:38:40.731917 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.731820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4" event={"ID":"a7660833-3eb2-414e-b7f9-36c2d5102e88","Type":"ContainerDied","Data":"3a6257375e7446bfbf66ad52a42938e17e07b64792669b39de2a618e52089419"}
Sep 10 12:38:40.731917 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.731854    2557 scope.go:117] "RemoveContainer" containerID="bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c"
Sep 10 12:38:40.733097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.733075    2557 generic.go:356] "Generic (PLEG): container finished" podID="202dd0f9-3509-431b-ab58-7323b91f35aa" containerID="38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c" exitCode=0
Sep 10 12:38:40.733178 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.733114    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"
Sep 10 12:38:40.733242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.733186    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj" event={"ID":"202dd0f9-3509-431b-ab58-7323b91f35aa","Type":"ContainerDied","Data":"38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c"}
Sep 10 12:38:40.733242 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.733235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj" event={"ID":"202dd0f9-3509-431b-ab58-7323b91f35aa","Type":"ContainerDied","Data":"74f427f73dca6032be58d800ccfd50d8d616b840bb02be04ae695de40689fb6f"}
Sep 10 12:38:40.740545 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.740531    2557 scope.go:117] "RemoveContainer" containerID="bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c"
Sep 10 12:38:40.740779 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:38:40.740760    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c\": container with ID starting with bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c not found: ID does not exist" containerID="bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c"
Sep 10 12:38:40.740818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.740786    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c"} err="failed to get container status \"bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c\": rpc error: code = NotFound desc = could not find container \"bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c\": container with ID starting with bee511658ff3ade1616dd380ad5a07b193207323d81e18ec9c80d946e57e0e0c not found: ID does not exist"
Sep 10 12:38:40.740818 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.740801    2557 scope.go:117] "RemoveContainer" containerID="38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c"
Sep 10 12:38:40.748599 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.748580    2557 scope.go:117] "RemoveContainer" containerID="38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c"
Sep 10 12:38:40.748862 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:38:40.748846    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c\": container with ID starting with 38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c not found: ID does not exist" containerID="38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c"
Sep 10 12:38:40.748911 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.748869    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c"} err="failed to get container status \"38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c\": rpc error: code = NotFound desc = could not find container \"38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c\": container with ID starting with 38802bae332c6a92c949ccf16b597685c5d852946a0f2f3051957dff4758d82c not found: ID does not exist"
Sep 10 12:38:40.749136 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.749120    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"]
Sep 10 12:38:40.757313 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.757292    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj"]
Sep 10 12:38:40.768975 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.768953    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"]
Sep 10 12:38:40.773371 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:40.773353    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4"]
Sep 10 12:38:42.388821 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:42.388795    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="202dd0f9-3509-431b-ab58-7323b91f35aa" path="/var/lib/kubelet/pods/202dd0f9-3509-431b-ab58-7323b91f35aa/volumes"
Sep 10 12:38:42.389124 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:42.389106    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7660833-3eb2-414e-b7f9-36c2d5102e88" path="/var/lib/kubelet/pods/a7660833-3eb2-414e-b7f9-36c2d5102e88/volumes"
Sep 10 12:38:46.582565 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:46.582527    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:46.682882 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:46.682851    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:46.713188 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:46.713165    2557 scope.go:117] "RemoveContainer" containerID="21b07e154c67b7e0c233c05adf8dd7f658910e0b271fcd61c85161f8a6dff865"
Sep 10 12:38:46.845331 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:46.845255    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"]
Sep 10 12:38:46.845524 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:46.845499    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy" containerID="cri-o://0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed" gracePeriod=30
Sep 10 12:38:46.876773 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:46.876749    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:47.196279 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196249    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"]
Sep 10 12:38:47.196635 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196623    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1349f1e5-26bc-48ed-a935-c10c6bbf0095" containerName="revoke-keys"
Sep 10 12:38:47.196682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196637    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1349f1e5-26bc-48ed-a935-c10c6bbf0095" containerName="revoke-keys"
Sep 10 12:38:47.196682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196653    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7660833-3eb2-414e-b7f9-36c2d5102e88" containerName="payload-processing"
Sep 10 12:38:47.196682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196658    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7660833-3eb2-414e-b7f9-36c2d5102e88" containerName="payload-processing"
Sep 10 12:38:47.196682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196676    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="202dd0f9-3509-431b-ab58-7323b91f35aa" containerName="payload-pre-processing"
Sep 10 12:38:47.196682 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196682    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="202dd0f9-3509-431b-ab58-7323b91f35aa" containerName="payload-pre-processing"
Sep 10 12:38:47.196831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196748    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="202dd0f9-3509-431b-ab58-7323b91f35aa" containerName="payload-pre-processing"
Sep 10 12:38:47.196831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196755    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab18766-3055-4331-9320-5ff3b2484e31" containerName="istio-proxy"
Sep 10 12:38:47.196831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196762    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1349f1e5-26bc-48ed-a935-c10c6bbf0095" containerName="revoke-keys"
Sep 10 12:38:47.196831 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.196769    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7660833-3eb2-414e-b7f9-36c2d5102e88" containerName="payload-processing"
Sep 10 12:38:47.201476 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.201460    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:47.204646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.204628    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:38:47.204646 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.204636    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jnqr7\""
Sep 10 12:38:47.210561 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.210540    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"]
Sep 10 12:38:47.298499 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.298474    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f\" (UID: \"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:47.298611 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.298523    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:47.400022 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.399997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f\" (UID: \"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:47.400620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.400596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f\" (UID: \"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:47.512194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.512137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:47.785933 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:47.785902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"]
Sep 10 12:38:47.786403 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:38:47.786375    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3daadc_4cf9_4a12_885e_8f8a70ec73ec.slice/crio-09350e2b825157f3e40d894e02d5cb61047a63549abb7150bf4b7e072f77d63b WatchSource:0}: Error finding container 09350e2b825157f3e40d894e02d5cb61047a63549abb7150bf4b7e072f77d63b: Status 404 returned error can't find the container with id 09350e2b825157f3e40d894e02d5cb61047a63549abb7150bf4b7e072f77d63b
Sep 10 12:38:48.777047 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:48.776985    2557 generic.go:356] "Generic (PLEG): container finished" podID="2d3daadc-4cf9-4a12-885e-8f8a70ec73ec" containerID="32d760296164b833f273f4524d9ce98512fe3af1acb8f0f5453e7b98249bcd1a" exitCode=0
Sep 10 12:38:48.777146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:48.777063    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f" event={"ID":"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec","Type":"ContainerDied","Data":"32d760296164b833f273f4524d9ce98512fe3af1acb8f0f5453e7b98249bcd1a"}
Sep 10 12:38:48.777146 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:48.777105    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f" event={"ID":"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec","Type":"ContainerStarted","Data":"09350e2b825157f3e40d894e02d5cb61047a63549abb7150bf4b7e072f77d63b"}
Sep 10 12:38:49.908620 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:49.908597    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:50.021313 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:50.021291    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec-maas-api-service-ca\") pod \"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec\" (UID: \"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec\") "
Sep 10 12:38:50.021616 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:50.021597    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d3daadc-4cf9-4a12-885e-8f8a70ec73ec" (UID: "2d3daadc-4cf9-4a12-885e-8f8a70ec73ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:50.122042 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:50.122020    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec-maas-api-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:50.788491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:50.788414    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"
Sep 10 12:38:50.788491 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:50.788456    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f" event={"ID":"2d3daadc-4cf9-4a12-885e-8f8a70ec73ec","Type":"ContainerDied","Data":"09350e2b825157f3e40d894e02d5cb61047a63549abb7150bf4b7e072f77d63b"}
Sep 10 12:38:50.788624 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:50.788496    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09350e2b825157f3e40d894e02d5cb61047a63549abb7150bf4b7e072f77d63b"
Sep 10 12:38:51.208884 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:51.208863    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:51.308245 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:51.308222    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:52.086661 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.086641    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:38:52.238024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.237966    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-envoy\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238024 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238012    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09b28d4f-0847-48ec-acab-561d4d33c162-istio-podinfo\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238035    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-certs\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238064    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-socket\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238131    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqtf2\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-kube-api-access-wqtf2\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238182    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-istio-token\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238226    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09b28d4f-0847-48ec-acab-561d4d33c162-istiod-ca-cert\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238253    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-credential-socket\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238274    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-data\") pod \"09b28d4f-0847-48ec-acab-561d4d33c162\" (UID: \"09b28d4f-0847-48ec-acab-561d4d33c162\") "
Sep 10 12:38:52.238396 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238292    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:52.238853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238511    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:52.238853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238583    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09b28d4f-0847-48ec-acab-561d4d33c162-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 12:38:52.238853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238594    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-credential-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.238853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238609    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.238853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238688    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:52.238853 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.238716    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-data" (OuterVolumeSpecName: "istio-data") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:52.240097 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.240073    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 12:38:52.240209 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.240188    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-istio-token" (OuterVolumeSpecName: "istio-token") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:52.240414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.240383    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09b28d4f-0847-48ec-acab-561d4d33c162-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 12:38:52.240414 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.240399    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-kube-api-access-wqtf2" (OuterVolumeSpecName: "kube-api-access-wqtf2") pod "09b28d4f-0847-48ec-acab-561d4d33c162" (UID: "09b28d4f-0847-48ec-acab-561d4d33c162"). InnerVolumeSpecName "kube-api-access-wqtf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 12:38:52.339703 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339675    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqtf2\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-kube-api-access-wqtf2\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.339703 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339704    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09b28d4f-0847-48ec-acab-561d4d33c162-istio-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.339817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339713    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09b28d4f-0847-48ec-acab-561d4d33c162-istiod-ca-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.339817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339722    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-data\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.339817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339728    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-istio-envoy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.339817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339735    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09b28d4f-0847-48ec-acab-561d4d33c162-istio-podinfo\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.339817 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.339742    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09b28d4f-0847-48ec-acab-561d4d33c162-workload-socket\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\""
Sep 10 12:38:52.799733 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.799711    2557 generic.go:356] "Generic (PLEG): container finished" podID="09b28d4f-0847-48ec-acab-561d4d33c162" containerID="0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed" exitCode=0
Sep 10 12:38:52.799836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.799759    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"
Sep 10 12:38:52.799836 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.799798    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" event={"ID":"09b28d4f-0847-48ec-acab-561d4d33c162","Type":"ContainerDied","Data":"0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed"}
Sep 10 12:38:52.799909 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.799847    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk" event={"ID":"09b28d4f-0847-48ec-acab-561d4d33c162","Type":"ContainerDied","Data":"7fcc405d97a7651dcd79416607aa5db610265df82fddfbef14ecf002b2ced93f"}
Sep 10 12:38:52.799909 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.799869    2557 scope.go:117] "RemoveContainer" containerID="0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed"
Sep 10 12:38:52.808996 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.808982    2557 scope.go:117] "RemoveContainer" containerID="fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"
Sep 10 12:38:52.817065 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.817050    2557 scope.go:117] "RemoveContainer" containerID="0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed"
Sep 10 12:38:52.817323 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:38:52.817305    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed\": container with ID starting with 0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed not found: ID does not exist" containerID="0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed"
Sep 10 12:38:52.817368 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.817330    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed"} err="failed to get container status \"0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed\": rpc error: code = NotFound desc = could not find container \"0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed\": container with ID starting with 0d67bbc01f8012e8aef55b6c099216823c5b921b738a931b106de609bb38c8ed not found: ID does not exist"
Sep 10 12:38:52.817368 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.817344    2557 scope.go:117] "RemoveContainer" containerID="fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"
Sep 10 12:38:52.818105 ip-10-0-139-133 kubenswrapper[2557]: E0910 12:38:52.818025    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e\": container with ID starting with fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e not found: ID does not exist" containerID="fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"
Sep 10 12:38:52.818105 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.818073    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e"} err="failed to get container status \"fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e\": rpc error: code = NotFound desc = could not find container \"fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e\": container with ID starting with fe0aeab26a1ea2a55a4a07c296ee9c9f40c4fcdd364d7a0d34721ba9cb1a0d5e not found: ID does not exist"
Sep 10 12:38:52.823105 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.823083    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"]
Sep 10 12:38:52.827253 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:52.827230    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk"]
Sep 10 12:38:54.389683 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:54.389659    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" path="/var/lib/kubelet/pods/09b28d4f-0847-48ec-acab-561d4d33c162/volumes"
Sep 10 12:38:57.833790 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:57.833761    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:57.927049 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:57.927021    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:58.045548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.045524    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:58.120588 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.120556    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"]
Sep 10 12:38:58.123435 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.123401    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-f89a79-dbs4f"]
Sep 10 12:38:58.133903 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.133878    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:58.215548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.215517    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:38:58.389307 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.389251    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3daadc-4cf9-4a12-885e-8f8a70ec73ec" path="/var/lib/kubelet/pods/2d3daadc-4cf9-4a12-885e-8f8a70ec73ec/volumes"
Sep 10 12:38:58.474127 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:38:58.474101    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:39:04.505938 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:39:04.505891    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:39:04.604671 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:39:04.604640    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:39:04.769035 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:39:04.768961    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:39:26.646384 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:39:26.646356    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:40:29.953345 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:40:29.953300    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:40:31.787500 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:40:31.787470    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:40:33.050724 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:40:33.050692    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:40:46.756804 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:40:46.756775    2557 scope.go:117] "RemoveContainer" containerID="07c14d8136395742230b70e807ca52df9b6123ebae4eafa0a0096e2cae1d8ac5"
Sep 10 12:40:46.764594 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:40:46.764566    2557 scope.go:117] "RemoveContainer" containerID="db125413fff182f750075b4e81892ef9a036c2039763e5d4ed2da45f7476ed3b"
Sep 10 12:41:05.719584 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:41:05.719541    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:42:16.858955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:42:16.858920    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:43:34.016079 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:43:34.016042    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:43:44.020000 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:43:44.019967    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:43:46.801184 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:43:46.801156    2557 scope.go:117] "RemoveContainer" containerID="c65756aa6a34f21dcc656d110d243d6abb49dff331e213040d2d28c462bb22e9"
Sep 10 12:43:46.809452 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:43:46.809412    2557 scope.go:117] "RemoveContainer" containerID="52d5f22a82cd8a668d055986b0d9200e803e75beb1306b85c5d68f699b0bd4e3"
Sep 10 12:44:11.977609 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:11.977532    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:44:22.533514 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:22.533481    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:44:24.372045 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:24.372005    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:44:40.741313 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:40.741284    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:44:46.831763 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:46.831733    2557 scope.go:117] "RemoveContainer" containerID="9315e586e7b7e8c2143c4e5a79f20350bbed626aff34d05e01fbed7ec5d36142"
Sep 10 12:44:46.839587 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:46.839567    2557 scope.go:117] "RemoveContainer" containerID="442ce0272cb09a628c16b807623a7fd4a0851133a4ba6f9bbbeb0eb913230bc6"
Sep 10 12:44:47.140644 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:47.140623    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:44:52.649399 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"]
Sep 10 12:44:52.649833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649817    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy"
Sep 10 12:44:52.649833 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649832    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy"
Sep 10 12:44:52.649925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649845    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy"
Sep 10 12:44:52.649925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649851    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy"
Sep 10 12:44:52.649925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649857    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3daadc-4cf9-4a12-885e-8f8a70ec73ec" containerName="revoke-keys"
Sep 10 12:44:52.649925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649862    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3daadc-4cf9-4a12-885e-8f8a70ec73ec" containerName="revoke-keys"
Sep 10 12:44:52.649925 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649919    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy"
Sep 10 12:44:52.650067 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649927    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3daadc-4cf9-4a12-885e-8f8a70ec73ec" containerName="revoke-keys"
Sep 10 12:44:52.650067 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.649934    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="09b28d4f-0847-48ec-acab-561d4d33c162" containerName="istio-proxy"
Sep 10 12:44:52.652743 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.652728    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.655573 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.655550    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 12:44:52.656716 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.656700    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-89jb9\""
Sep 10 12:44:52.656804 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.656698    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 12:44:52.656804 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.656735    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 12:44:52.656804 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.656771    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 12:44:52.664619 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.664597    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"]
Sep 10 12:44:52.787576 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.787549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bfvn\" (UniqueName: \"kubernetes.io/projected/ef6fd04c-b188-4457-b8f0-9ec822dea4af-kube-api-access-2bfvn\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.787707 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.787587    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6fd04c-b188-4457-b8f0-9ec822dea4af-maas-api-tls\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.787707 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.787675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6fd04c-b188-4457-b8f0-9ec822dea4af-metrics-certs\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.787808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.787730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6fd04c-b188-4457-b8f0-9ec822dea4af-openshift-service-ca\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.888459 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.888416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6fd04c-b188-4457-b8f0-9ec822dea4af-openshift-service-ca\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.888572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.888500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bfvn\" (UniqueName: \"kubernetes.io/projected/ef6fd04c-b188-4457-b8f0-9ec822dea4af-kube-api-access-2bfvn\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.888572 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.888539    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6fd04c-b188-4457-b8f0-9ec822dea4af-maas-api-tls\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.888688 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.888593    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6fd04c-b188-4457-b8f0-9ec822dea4af-metrics-certs\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.888950 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.888933    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef6fd04c-b188-4457-b8f0-9ec822dea4af-openshift-service-ca\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.890943 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.890922    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef6fd04c-b188-4457-b8f0-9ec822dea4af-metrics-certs\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.891003 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.890922    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef6fd04c-b188-4457-b8f0-9ec822dea4af-maas-api-tls\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.897457 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.897418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bfvn\" (UniqueName: \"kubernetes.io/projected/ef6fd04c-b188-4457-b8f0-9ec822dea4af-kube-api-access-2bfvn\") pod \"maas-api-6fcd467ffd-pnzdq\" (UID: \"ef6fd04c-b188-4457-b8f0-9ec822dea4af\") " pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:52.963454 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:52.963384    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:53.240086 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:53.240058    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"]
Sep 10 12:44:53.240399 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:44:53.240379    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6fd04c_b188_4457_b8f0_9ec822dea4af.slice/crio-008eb79414535d7b32171901a7c2d9aba9c5d311acae2be05deec9e5facb114a WatchSource:0}: Error finding container 008eb79414535d7b32171901a7c2d9aba9c5d311acae2be05deec9e5facb114a: Status 404 returned error can't find the container with id 008eb79414535d7b32171901a7c2d9aba9c5d311acae2be05deec9e5facb114a
Sep 10 12:44:53.241765 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:53.241744    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 12:44:53.618865 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:53.618832    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq" event={"ID":"ef6fd04c-b188-4457-b8f0-9ec822dea4af","Type":"ContainerStarted","Data":"008eb79414535d7b32171901a7c2d9aba9c5d311acae2be05deec9e5facb114a"}
Sep 10 12:44:55.631712 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:55.631683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq" event={"ID":"ef6fd04c-b188-4457-b8f0-9ec822dea4af","Type":"ContainerStarted","Data":"3dbb098c0e0820fbbc3d44735b454fd80ac5847497f21401dfb0e51a41af811d"}
Sep 10 12:44:55.632007 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:55.631786    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:44:55.653485 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:44:55.653441    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq" podStartSLOduration=1.453282804 podStartE2EDuration="3.653412428s" totalImagesPullingTime="2.200129624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:44:55.651318688 +0000 UTC m=+2109.745498888" watchObservedRunningTime="2026-09-10 12:44:55.653412428 +0000 UTC m=+2109.747592617"
Sep 10 12:45:01.641345 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:01.641315    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6fcd467ffd-pnzdq"
Sep 10 12:45:20.603792 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:20.603766    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cvknj_5e35f824-2444-4854-acde-0ce12b7bda19/server/0.log"
Sep 10 12:45:20.718794 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:20.718771    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xm26t_703d1f18-1d2c-4324-a62c-c85e1f65218b/manager/0.log"
Sep 10 12:45:20.952494 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:20.952470    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f75798bc7-rjs2s_d25a5466-b58f-4652-af8b-4a368a6ddf05/copy-manifests/0.log"
Sep 10 12:45:20.958659 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:20.958639    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f75798bc7-rjs2s_d25a5466-b58f-4652-af8b-4a368a6ddf05/manager/0.log"
Sep 10 12:45:21.400148 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:21.400128    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6fcd467ffd-pnzdq_ef6fd04c-b188-4457-b8f0-9ec822dea4af/maas-api/0.log"
Sep 10 12:45:21.631405 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:21.631384    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817390-qh9dz_1f981041-80dc-4054-b84a-e41d4741e762/cleanup/0.log"
Sep 10 12:45:23.608201 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:23.608177    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m_8051cce7-d888-4a67-8776-f08533a002ff/istio-proxy/0.log"
Sep 10 12:45:23.722812 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:23.722752    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lwrx8_6e733980-623a-4c4e-bbe2-f72e3d9568e7/discovery/0.log"
Sep 10 12:45:24.070249 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:24.070161    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/1.log"
Sep 10 12:45:24.753998 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:24.753975    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qbv9z_83638eb6-1a44-4bd4-b6c8-4e9fd06e80ab/main/0.log"
Sep 10 12:45:24.869906 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:24.869889    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-f9bm7_7bb1d0bc-1274-4b9a-8ac7-8bc5b95d0459/main/0.log"
Sep 10 12:45:25.083037 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:25.082977    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zhvc4_023f5459-d281-48bd-b204-86012ce7e23c/main/0.log"
Sep 10 12:45:31.179106 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:31.179075    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:45:31.267878 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:31.267847    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log" limit=1024
Sep 10 12:45:34.295158 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:34.295130    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xn6sq_8a9acddb-5d80-44e9-ae12-025daecdbc0e/global-pull-secret-syncer/0.log"
Sep 10 12:45:34.343906 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:34.343874    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cgxj9_dc9274c0-a1f3-42c1-a941-68f36180a1db/konnectivity-agent/0.log"
Sep 10 12:45:34.511617 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:34.511597    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-133.ec2.internal_cecf6a195bd7af1b2519a96aa95ed769/haproxy/0.log"
Sep 10 12:45:40.468592 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.468518    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/alertmanager/0.log"
Sep 10 12:45:40.494622 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.494598    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/config-reloader/0.log"
Sep 10 12:45:40.535880 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.535864    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/kube-rbac-proxy-web/0.log"
Sep 10 12:45:40.574149 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.574129    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/kube-rbac-proxy/0.log"
Sep 10 12:45:40.599437 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.599415    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/kube-rbac-proxy-metric/0.log"
Sep 10 12:45:40.626271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.626251    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/prom-label-proxy/0.log"
Sep 10 12:45:40.652944 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.652927    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7fbe42ed-ad73-439b-8a17-0c1c2bd06a88/init-config-reloader/0.log"
Sep 10 12:45:40.740166 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.740114    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pvrlm_b1fc675d-0a27-482b-a528-ef9d1301dd67/kube-state-metrics/0.log"
Sep 10 12:45:40.765931 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.765914    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pvrlm_b1fc675d-0a27-482b-a528-ef9d1301dd67/kube-rbac-proxy-main/0.log"
Sep 10 12:45:40.793043 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.793025    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pvrlm_b1fc675d-0a27-482b-a528-ef9d1301dd67/kube-rbac-proxy-self/0.log"
Sep 10 12:45:40.826678 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.826662    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-754dbb677c-zz9j8_58de450d-9040-4d9a-995f-cca26e6d93de/metrics-server/0.log"
Sep 10 12:45:40.853964 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.853949    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-w4xjc_a3304870-747e-4a5c-b7e7-a1fb121f0239/monitoring-plugin/0.log"
Sep 10 12:45:40.899970 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.899950    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kntmr_167f4dc2-0a29-43ed-a906-952df4d340b1/node-exporter/0.log"
Sep 10 12:45:40.957333 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.957314    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kntmr_167f4dc2-0a29-43ed-a906-952df4d340b1/kube-rbac-proxy/0.log"
Sep 10 12:45:40.982490 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:40.982476    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kntmr_167f4dc2-0a29-43ed-a906-952df4d340b1/init-textfile/0.log"
Sep 10 12:45:41.575808 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.575787    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-499r6_8d8439d4-f904-4e68-aad9-a4dcddf44ee2/prometheus-operator/0.log"
Sep 10 12:45:41.613647 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.613624    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-499r6_8d8439d4-f904-4e68-aad9-a4dcddf44ee2/kube-rbac-proxy/0.log"
Sep 10 12:45:41.870842 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.870825    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5fd8784b-ggprk_b367d18a-57de-4071-9ae3-c2fa90d8bbf9/thanos-query/0.log"
Sep 10 12:45:41.908940 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.908917    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5fd8784b-ggprk_b367d18a-57de-4071-9ae3-c2fa90d8bbf9/kube-rbac-proxy-web/0.log"
Sep 10 12:45:41.939548 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.939532    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5fd8784b-ggprk_b367d18a-57de-4071-9ae3-c2fa90d8bbf9/kube-rbac-proxy/0.log"
Sep 10 12:45:41.966194 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.966174    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5fd8784b-ggprk_b367d18a-57de-4071-9ae3-c2fa90d8bbf9/prom-label-proxy/0.log"
Sep 10 12:45:41.995305 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:41.995286    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5fd8784b-ggprk_b367d18a-57de-4071-9ae3-c2fa90d8bbf9/kube-rbac-proxy-rules/0.log"
Sep 10 12:45:42.022975 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:42.022953    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5fd8784b-ggprk_b367d18a-57de-4071-9ae3-c2fa90d8bbf9/kube-rbac-proxy-metrics/0.log"
Sep 10 12:45:43.730482 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.730450    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"]
Sep 10 12:45:43.734686 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.734671    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.737672 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.737653    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htg6h\"/\"openshift-service-ca.crt\""
Sep 10 12:45:43.742098 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.742077    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htg6h\"/\"kube-root-ca.crt\""
Sep 10 12:45:43.742332 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.742315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-htg6h\"/\"default-dockercfg-cc8xr\""
Sep 10 12:45:43.748629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.748611    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"]
Sep 10 12:45:43.867730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.867700    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-lib-modules\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.867730 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.867728    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-podres\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.867879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.867753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-sys\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.867879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.867833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kbms\" (UniqueName: \"kubernetes.io/projected/b349fbdc-d2b2-4ded-a1bb-101ac2484995-kube-api-access-6kbms\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.867879 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.867877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-proc\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969000 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.968981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-lib-modules\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-podres\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969070 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969031    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-sys\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969086    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-sys\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kbms\" (UniqueName: \"kubernetes.io/projected/b349fbdc-d2b2-4ded-a1bb-101ac2484995-kube-api-access-6kbms\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969136    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-lib-modules\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969173 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-proc\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969325 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-proc\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.969325 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.969135    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b349fbdc-d2b2-4ded-a1bb-101ac2484995-podres\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:43.981150 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:43.981103    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kbms\" (UniqueName: \"kubernetes.io/projected/b349fbdc-d2b2-4ded-a1bb-101ac2484995-kube-api-access-6kbms\") pod \"perf-node-gather-daemonset-lvmt2\" (UID: \"b349fbdc-d2b2-4ded-a1bb-101ac2484995\") " pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:44.044050 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:44.044031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:44.315521 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:44.315494    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"]
Sep 10 12:45:44.316411 ip-10-0-139-133 kubenswrapper[2557]: W0910 12:45:44.316389    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb349fbdc_d2b2_4ded_a1bb_101ac2484995.slice/crio-d8f5c4d02af0c710e07d0a7452142e5e2c2f8ab83669a0e1d265c40f7677154f WatchSource:0}: Error finding container d8f5c4d02af0c710e07d0a7452142e5e2c2f8ab83669a0e1d265c40f7677154f: Status 404 returned error can't find the container with id d8f5c4d02af0c710e07d0a7452142e5e2c2f8ab83669a0e1d265c40f7677154f
Sep 10 12:45:44.865299 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:44.865271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2" event={"ID":"b349fbdc-d2b2-4ded-a1bb-101ac2484995","Type":"ContainerStarted","Data":"0ca21e6e0407d9a6a2bfae6e1ff71919bfa91d28f21c1841a7a75354f26ac636"}
Sep 10 12:45:44.865629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:44.865317    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2" event={"ID":"b349fbdc-d2b2-4ded-a1bb-101ac2484995","Type":"ContainerStarted","Data":"d8f5c4d02af0c710e07d0a7452142e5e2c2f8ab83669a0e1d265c40f7677154f"}
Sep 10 12:45:44.865629 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:44.865411    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:44.885473 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:44.885413    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2" podStartSLOduration=1.885401346 podStartE2EDuration="1.885401346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:45:44.882888385 +0000 UTC m=+2158.977068576" watchObservedRunningTime="2026-09-10 12:45:44.885401346 +0000 UTC m=+2158.979581535"
Sep 10 12:45:46.420110 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:46.420089    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxnhp_143a207c-76eb-4a9b-b4d1-cd61360b7230/dns/0.log"
Sep 10 12:45:46.446537 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:46.446517    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxnhp_143a207c-76eb-4a9b-b4d1-cd61360b7230/kube-rbac-proxy/0.log"
Sep 10 12:45:46.585271 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:46.585250    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kjkm6_991e1107-6aec-4eb1-bbca-cda61a517017/dns-node-resolver/0.log"
Sep 10 12:45:46.861668 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:46.861649    2557 scope.go:117] "RemoveContainer" containerID="32d760296164b833f273f4524d9ce98512fe3af1acb8f0f5453e7b98249bcd1a"
Sep 10 12:45:47.256044 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:47.255992    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtncr_6aa15bd8-8bd6-4d32-95d3-c2a933917512/node-ca/0.log"
Sep 10 12:45:48.269875 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:48.269855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m_8051cce7-d888-4a67-8776-f08533a002ff/istio-proxy/0.log"
Sep 10 12:45:48.477170 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:48.477148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lwrx8_6e733980-623a-4c4e-bbe2-f72e3d9568e7/discovery/0.log"
Sep 10 12:45:48.562266 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:48.562218    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/0.log"
Sep 10 12:45:48.569930 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:48.569907    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/1.log"
Sep 10 12:45:49.675535 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:49.675512    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zzf6x_b9184e5e-44a4-41c2-85ed-b76e037c9fa0/serve-healthcheck-canary/0.log"
Sep 10 12:45:50.213869 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:50.213844    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2d9ml_10bddce8-4267-46bc-bd99-7eedc0c1e2fe/kube-rbac-proxy/0.log"
Sep 10 12:45:50.236685 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:50.236660    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2d9ml_10bddce8-4267-46bc-bd99-7eedc0c1e2fe/exporter/0.log"
Sep 10 12:45:50.262218 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:50.262196    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2d9ml_10bddce8-4267-46bc-bd99-7eedc0c1e2fe/extractor/0.log"
Sep 10 12:45:50.880541 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:50.880516    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-htg6h/perf-node-gather-daemonset-lvmt2"
Sep 10 12:45:53.131111 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:53.131090    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cvknj_5e35f824-2444-4854-acde-0ce12b7bda19/server/0.log"
Sep 10 12:45:53.215108 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:53.215084    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xm26t_703d1f18-1d2c-4324-a62c-c85e1f65218b/manager/0.log"
Sep 10 12:45:53.385101 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:53.385048    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f75798bc7-rjs2s_d25a5466-b58f-4652-af8b-4a368a6ddf05/manager/0.log"
Sep 10 12:45:53.411689 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:53.411672    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f75798bc7-rjs2s_d25a5466-b58f-4652-af8b-4a368a6ddf05/copy-manifests/0.log"
Sep 10 12:45:53.876519 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:53.876495    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m_8051cce7-d888-4a67-8776-f08533a002ff/istio-proxy/0.log"
Sep 10 12:45:54.076918 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:54.076895    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lwrx8_6e733980-623a-4c4e-bbe2-f72e3d9568e7/discovery/0.log"
Sep 10 12:45:54.123625 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:54.123604    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/0.log"
Sep 10 12:45:54.131230 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:54.131176    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/1.log"
Sep 10 12:45:54.682988 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:54.682965    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74996bc6f6-pq4jl_cb2dde1a-583c-4f20-b5ae-fc974c01463a/manager/0.log"
Sep 10 12:45:54.764153 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:54.764135    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lwbtk_07b7f0c1-0e18-4423-9ac6-0e95cb2663a0/openshift-lws-operator/0.log"
Sep 10 12:45:55.703275 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:55.703251    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m_8051cce7-d888-4a67-8776-f08533a002ff/istio-proxy/0.log"
Sep 10 12:45:55.916955 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:55.916931    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lwrx8_6e733980-623a-4c4e-bbe2-f72e3d9568e7/discovery/0.log"
Sep 10 12:45:55.975469 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:55.975399    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/0.log"
Sep 10 12:45:55.984334 ip-10-0-139-133 kubenswrapper[2557]: I0910 12:45:55.984315    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6t8xw_58d8d628-de27-4af9-82dd-4aca34bc3666/istio-proxy/1.log"